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. INTRODUCTION 

T-ho c«mi)at(>r pj/fg^rns'dost nb(>d'in this njanual were designed tor 
the analysis ot data resulting tr^n^ psychojogical t>xperiments which 
hyp<)lljt>si/(> an aplitucfe- or trcjit-treatnu-nt int^ac tion (MH, The pro- 
grams vvvre written tor tour designs which either have- appeared Ire- 
quently.in reported studies ot A\\\ or which have resulted trom the ' 
authors' «wn resecm h < <^nduc tf-d at the Research and Dev(-lo|)ment 
Center'tor Teachericlucation, Jhe University ot Texas at Austirt. and 
-^nsored grants fr(«n..the U S. ()ttk<> ot tducali^i and <he Na- 
tionailnstitute ot Ldutat'ion , 

• The researc h designs to whic h the, programs jii this manual are ap- 
plicabU; r(<|t(<sent paradigms which test tor a|)tilude-by-trealment .in- 
teractions when la) one continuous aptitude or trait has been 

. measured ih.^t is linearly reflated to the- c ritc-rion (prWrann ATlllNI). 
" 'bi two continuous aptHudes or traits have been measured that ar(> 
linearly:rc-latc-dt<)thcMritc-rion (program A I II IN2), ic i pm> c ontinuous 
. a|)tffude or trait has Ikhmi mc-asured that is c urvilinearly related to the 
criterion (program AT K UK VL .ind icD one- aptitude or trail has been 
measured that is iincarlv [c-lalc-d to the criterion and group si/es arc> 
sultictf-ntly large- to |H-rmit a trcMlmc-nl-hy-bloc ksanalysis'ot vacianci> 
„n individuals 5vith c-xtfcmc- scores in the aptitude- distribution lpro- 
gram X(.R( )lll'S-'. Program XGROUPS has been dJ-signed tcjjncrease 
the statistical powVr ot an All analysis ancMhc-rctiy increAse its sc-n-, 
sitivity t(» detc'c ling an aptituclc'-by-trcvitrm-nt injeraV Hon. 

lath ot. the- tou'r programs to be; cic-sc ribecl has been wVitten tor tHe 
case in which there, art- two trcMlments and eiVher one or two ap- 
titudc-s These c oixlitioiT*;- need not be- limitjngjiowc-ver, in that-the 
programs (an.be easily mn<M\vi\ to hancll*> riiye c omplex c onditio'ns 
as the- modc-ls tor thc-sc- are but sim|)le extc-nsions ot.thote used to 
' construct the- present programs, Also, it has bec-ri the authors' c-x- 
• . pcHu-nce in using the- programs that, even when more than two treat- 
mcMils or aptitudes arc- prc-senl, the invc-stigator will usually reduce 
• the problem to a simpler c onditi(;ji tor interprc-tative purposes. Whc-n 
there are more than two frc-atmc-nts, the- investigator can conduct 
pairwise comparisons and, it iFierc- arc- more than two nptitude.s. 
-.(-Ic-c 1 pairs ot aptitudes for wNch the- aptitudes are minimally related 
to c-ach other and maximally relalc-d to the critc-rion. 
- ' Retc<rc<ncc- to these- and othe-r technical issues are' made, in the 

• nie/hof/oloKual no/es' which ac c ompany eac h of ih^fT'^ograms de- 
scribed in this manual. The descriptions and illustrations containe-e 
within the- melhodolejgical nojes re-view and oe e asionc>lly go beyond 

Q (Silent provide-c'l by standard statistical te-xts which coyef-the-se pro- 

; ■' • ■ ■ ■ .6 ■ 
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^((•(luros rhc us(v, I, (>n( ,H,ra>>(>(l to siudy these notes to gain a lull un- . 
(lersianding ot th(> ^urpo^os and .statistical procedures (.Hn()loyed by 
the programs Suc h sttidy Will be- helpful, it noi'prereciuisile, to com- 
[X)Mng a tuJI and acc urate\inter()retation oi results. 

The user may also tind n,el()ful- the'-annotated bibliography which 
appears at the c one lusion o|the manyal and the tollowing general ar- 
ticles aboijt the programs tflemselve: 

/ Pnifirjm AnUNI 



One continuous aptitude- liL-arV rc-latc-d to thexWe 



rion. 



Bonch, (,._^D. Intc-factionslimong group , rc-grcssions: Testing 
homogc-nc-ity ot grou() rc-grc-ssiUns and plotting rc-gions of signifi- 
cance. [(Mfauonjl- anc/ Psyc /i^c^^k a/ Mc-dsurc-mcn( 1971 i1 



<, 2. I'rogrjm AIIU\2 



Two cc)ntinu()u4^aplityidc-s lincMri rc-lated to the criterion. 

. Boric h. Ci. D., &- Wuriderlic h, K, VV. )ohnson-Neynrian revisited; 
Determining interactions among gi\)u() rc-gr»ssions dnd plotting 
regionv of significance in the- case- of tWo groups, two prpdic tors and 
one criterion, f due anona/ ancy Psyc ho%/cd/ Mcasuremen/ 197 3 31 
1T1-1S9. ■ ,, - * * ' ' " ' 



I frogrdm ATICURV 

One continuous a()titudc- c urvilinc-arly \elatcd to the criterion. 
VVunderlich, K. W.. ^^^ Boritji, G. D. rx-lrmining interactihns and 
regions of significance- tor curvilinc-ar rc-g\c-ssipns. Educuional and 



/'•.v-(/5c;/o^{/ca/ ,V/easurcmen(, 197 5, ) ), ()9lib95. 



'4. Profiram XCROUPS' 

' One a()titudc- linearly rc-lated to the- c ritc'ri()i| and large group sizes. 

Borich.-C. [>„ & C,odbout, R. C. Extreme- groups de-signs and the 
(al(ulajic;n of statistical power. fducanona\ anc/ &yfhc)foi'/Va7 
. Mcjsufvim'tn, 1974, i4, M->i-b7l. . \ 

ErJc ^ , . 7^ 
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CHAPTER 1 
ORGANIZATION OF THE PROGRAMS 

The programs described in this manual were written m Fortran IV 
versions that are appropriate tor^use on most CDC (>4()0/66()() and '\ 
IBM 360 computer systems. With^smalkmoditications the pro-ams 
can be made compatible with a variety of other computer systems, 
such as DEC-10 and UNIVAC. The user should coQsutt hfs compula- 
tion center to determine the appWcability of the present programs. 

The computer programs to be described fpllow a similar sequence 
of operations, this sequence being 

* . • 

1. read in formation from the litte, parameter and format^ cards 
• and read data (subroutine CCD),, 

2. deleft^ missing and/or invalid;data (subroutine AMISDAT). And 

3. calculate summary statistics. 

Program's ATILIN1 , ATILIN2, ^ind ATlCURV: 

4. test for the homogeneity of group- rc^grc^ssions, 

5. test for common .interc-epts (analysis of covariance), 
6/ define region^! of significance, , 

7. determine point Is) or line at which rc^gressions intersect, and 

8. plot, group regressions and regions of sifgnificanccv 

' Program XC^ROUPS: ' _ , 

4. performs a treatment-by-blocks ANOVA on (extreme scores^^ 

and 

5, . estimates statistical power for main and interaction etiec ts. 
Each of these operations is dislussc^d bric^fly below, ^ 

Subroutine- CCD 

/^Subroutine CCD ()erfofms the tirst set of operations for all programs. 
This subroutine is used to input information from the control xards 
(the title control card, the parameter control card and the format con- 
trol cards) which define each problem to^be process^d^^'^fore return- 
ing control to ATltlNI, ATJLIN2, ATlCUftV ^(GROUPS, the 
subroutine prints the intTKma'tion conjained on the three control 
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( ards Al ih(^ start ot tfuvfoutinc, \hv ( onlrol ( ar(J is (»\aniin(»(l to 
(l(M(»rmin(» vvh(»th(»r this < ard is l)lank. It ihv litk' card is blank, a STOP- 
slat(»m(»nt terminates ution (.)t th(» [)r()^ranT This ( hara( tent ist*i( 
allows th(» us^T to [)ro((»ss nHjlli[)K» prohk^ms witfiin a -Mn^k* )ol).' 
When a |)robk»ni is < ompleti^L sul)routin(» C ( I) is (aH(»(l and the next 
(ard IS read. It this (ard is l)lank then the last problem Ivis been ( om- 
•|)kM(»(l and the execution t(»rminat(»s It this card is not hlaiTk, lh(»n it 
r(»presenls the title uud.tor an additional f)rol)k»m and pro((»ssing 
(ontinues * - , 

MCilnpIc fnoblvm \fn<nvssfni^ A\ hi»n (he user wishes to pro(i»ss 
nHilti()k» ()rol)k»ms within a sin^k» job, data tor all problems must 
tollovv lh(» (onlrol cards tor the tirst problem ancTfirecede thiMontrol 
(ards tor sul)s(»cjuent pr()l)lems. During the rirst (cdl t(,) subroutine 
CCD. alt data an* riMd and then written in card ima^i* torm on a 
^sUalch tapiv The data <i[)[)i:()[)riate to a ^ivenj)robk>m arc* obtnin(»(l 
l)V rt»ttTen( iMo ttuM.lat,i tape with the tormats provi(k»d in th(» control 
I ards tor that problen). Sue h multiple probk'm proc(»ssinj> is a[)[)ropri- 
al(» onlv whi'n all problems deal with thi^ samc» pair'ot trcMtmcuit 
groups Pr()[)lenis involving (lutc»ri»nt pairs ot trcMtmc^nt ^roups^must 
sul)mitted as se[)arati» }ol)s. 

•J 

Subroutine AMISDAT 

JmrnculiattHv atu^jhe ( all to sulKoutinivCC (), subroutine* AMtSOAT is 
(alk»(l t.(')r the purpose^ot (k»kMin^ missing and or invalid data. This 

j;oulini» IS (otitroHiHl l)v the missing data option (c>)lumn 12 on t"hi* 
paramiM(»r (ardi VVh(»n a 0 is pinn hc»d in column 12 of the [)aram(^t(»r 
(ard, su[)routtni» AMISDAT will (onsidrr all data valid; whcui a ris 
pun(h(»d in (olumn 12. all blanks will be* c()ns^derJ(l invalid;- and 

nvh(»n a 2 is punc hc^l in column 12, both blanks. and O's are con- 

■st(|(»r(^cl irtvalid. In tfiat thc^ missing data subroutine* prea»d(»s all oth(»r 
cakulations, onlv data which mcuM thc» specific atkios ioalvd in th(» 
nl^sslng data cok?mn ot thc» paramiMc^r card, are anafyzc^cL 

Calculate Summary Statistics 

follow ing.thc^ missing data o[)tioivs(>([U(»nc c», eac h [program cakxilates 
withfTi'-grouf) sunimary statistics. For [Kograms ATILINI. ATTLIN2 and 
ATIC.UKV, summary statistic vc onsist ot grf)up si/(»s, mcMns, standard 
d.eviat ions, and' c orrc^lat ions. Sirmmary statistic Sv^tor program 
'"jROl'PS ( onsist ot cell mcMns tor the* two'main (»ttects (groups c\nd 
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treatments) and for the grou|)s-l)y-treatmenl inierai tibn. WhtfrlTver 
standard deviations are calculated as summary statistic s, the prmtcnl 
value will be a sample statistic and not an estimate of the parameter 
value Therc>tori«. f(ir the table of summary statistics, standard devia- 
tions are calculated with the number of scores (N) in the denominator 
rather than the degrees ot freedom (e.g., V /) I Isewhere; where 
unbiased estimates of the parameter ■valu(> are Tequirc^i, the degrees 
of freedom are used in the denominaior. - . 

Homogeneity of Group Regressions Test 

For proj^rants ATILINI , ATILIN2 and ATICURV, the fourth slop in the 
secitience is a regression analysis test for the presence of an aplilude- 
by-lrealment interaction. This homogeneity of gcoup regressions K-st 
involves the null hypothesis that group regressions (criterion on ap-. . 
tittrdei are parallel, or, eciuivalently, that group slopes are equal 
'b, b^l,. Reiec tion of this null hypothesis indicates the existence of 
an aptitlide-bv-treatment interaction. This regression method for. 
determining aptitude-by-treatment interac tions differs from the tradi- 
tional factorial analysis of variance (ANOVA) methods in that an ap- 
titude commonly dichotomized or U4cholomized to fit the factorial 
structure of analysis of variancl- is used in tho regression method as n 
continuous measure to desc ribe as many different types ot subjc-c ts as 
there are observed values of. a particular a|ilitude. Cronbach and 
Snow (147 5" p.- 518* have shown that for the c ase in whic h there is a 
moderately strong interac tion, the statistical power of a tesM which 
employs the aptitude as a continuous variable is superior to blocking 
the aplilLvtie at the median, blocking at the ,5 5rd and b7lh percentiles 
■ or similar configurations that may be employed in a treatmc-nt-by- 
blocks AtLoVA dosigh.- These .Hithors have concludecl that by 
employing the homogeneity of group rc-gressions test rather than a 
median sjit, .i^out one-third fewer cases are reciuired to maintain 
the same ("vel of power (see Borich, 1')7S). 

, Test of Common Intercepts (Analysis of ^ v, 
Covariance) 

"Following the homogeneity of^ group regressions test, ATILINI, 
ATIIIN2 and ATICURV test for-common intercepts. This lest is com- 
monly referred to as "analysis of ccwariance" and tests the signiti- 
O ance of the difference between group regressions at the mean of the 



af)Htudo variahlo. I his losi is nol intvrprotod whon tho investigator 
rojecls Iho nuN hypothesis tor iho homogenoityOt group regressions 
lost, i.e., finds an a()titude>by-treatment interac tion. However, when 
group regressions are homogeneous the Investigator may test the hy~ 
. f^)lhesis that the mean of Treatment 1 significantly differs from the 
mean of Treatment 2 when^ll subjec ts in Croufxs 1 and 2 score at the 
mean of (he aptitude variable. Thii n(*w...adjusted' group mcMns for 
this analysis are determined by inserting the aptitude mcMn into the 
regression c^C|uati(*ns for Croup I and (.i»)up 2 and 8^)lving cmc h for V, 
the adjusted group mcMo. 
' '* 

Points of Intersection* . / 

y 

ATUINI, ATILIN2 and ATICURV cieterrtiine the point or points at 
• w.hich .the regrc^ssioh lines iAPILIN]}, planers {ATILIN2) or curvets 
'ATICURV) 'intc^rscHt. In the, case of the one-predictor, ATIUN1, 
model, rhcTe will be oae point of mterscn tion if thc^" group regrc-ssion^ 
are not' parallel. In thc^- c ase of the two-apt itucie, ATILIN2, mc)d(4, a 
straight line.clefmc's illV intc^rscn tion ()f two" nonparallel regrc»ssi()rj 
pjanes. This line is c^llejf the "line of nonsignificance" or the "line of 
no difference betwc^Wgrc^suin planers," For ATICURV, there may 
be aone/unc', or tW(i*f<otnts of Intc^rscH tion. Points of intCTsec tion will 
i^e useful t(j the usc^r in visualizing regions of significance which, if 
present, will always b(^ dvimvd to the right and or of the pointlsV 
^ or line of inlersec tion. ' ' ' r 

Regfons of Significance 

A region ot signific anc v dc^c ribes a range of valuers of a prc^dic tor Tap- 
titude) variable for which there are signific ant group diffetences on 
the criterion— that is, the separation of the rc^grc^sfon linens is signifi- 
cant ly dttlerenllrom (X The .difiorcnue bet wcH^n groups (V^^ V^) will 
br exactly 0 at a [)oint or^line of intersec tion and the group 
differences will bo nonsignificant at vakfevs c)f the predigor variable 
whic h he c lose to an inte^se^c tionMrcMs farther to the right and/or the 
left of an inte^rsection in whic h group diffewxe^s. are significant 
define the re^gions of signific anc e. There may be either one (to the 
right (jrlefl) or iwo (to the right dndle^ft) re^gions of significance about ■ 
an intersection. The calculations of re^gions of significance that are 
performed by the f)r()grams in this manual follow or are extensions of 
^♦'^•■mulas m out by Johnson and Neyman ( I9.J6). The user ma.y be in- 



:terosl€Kl iRothor, ♦inalo^ous procedures for calctrlaling regions of sjg- 
nificance which are reporlc^cl in. an arlicle by Cahen and Linn (1^71). 
This- article is annotated in the bibliography that appears at the con- 
clusion of this manual. 

0 

Plotting Regions of Significance 

Programs ATILIN1, AT1L1N2 and ATICURV employ a graphical output 
routine which constructs a^catter plot, draws the within-group 
rc^gresslons and delTneatc^s the regions of -significance. The programs, 
allow the user to choose a 12 x 10 inch paper plot, a microfiche plot 
for use ds a photographic negative, or no plot. As the programs them- 
strives do not calculate the. number of cases which fall within the' 
regions of signifilance, it Is important that use/s use* the plot option 
whenever possible to insure^ themselves that any regions oi signifi- 
cance that may be clefinc^d are*of practical importance. 

Users willTieed to check with their computer installation to deter- 
mine if a plotter is available. Users whose installation^ do not include 
a plotter must indicate the ';no plot" option on the parameter control 
card, and thc^se users may find it necessary to insert dummy 
subroutines named PLT, SYMBOL, NUMBER, LINE, PLOT, AXIS, SCALE, 
BCNF^LT, and ENDPLT. The forrft Of thc^se dummy subroi^tines is as 
follows. ' ' . » 

'.. SUBROUTINE PLT (E1, F2. I) 

RETURN " ' 

END ' V 

Ap[)roprial(^ subroutine name cards for the remaining plotting 
subroul'ines are: 

.0 ... v 

SUBROUTINE BC;NPLT (11, Fj, 12. li) 

subroutinl^endI'lt ' - . 

SUBROUTINE SYMBCX (Fl. F2/Fi, 11, F4', 12) 
, SU8ROUTlNL'LirSE4F1, F2/11J2, 13, 14) " , ; 

SUBROUriNt SC:AL[ (Fl, F2. 11J2) 

SUBROUTINE AXIS^jF I, F2, Vl, 12,'Fi,F4. F5, Fb). ' . 

■ / \ ' ■ " ' ^ , 

The. gVaphical output routine included in the preserit programs Is 

appropnate to the CalComp plotting package. (California Computer 

"Produc is, Inc.rAnaheim, California). It will be necessary to alter the 



plotting^ routine wilhinMho |K(»s(»nl programs tor use with olher 
^graphical output packages. * ^1 

Jhe^graphical output routine included >n the present programs re* 
quires the followTng subroutines: 



PUT: • 

SYMBOL: 
\ 

NUMBER: 



converts all pen (beam) movements from inches tc) 
devil e c ommands and eremites an appropriate file of 
lh(*se commands. 

i 

ciraws any sequence ot ( haracters arid symbols. The 
entry point SYMSLT can be usckI tc> redefine any 
symbol, SYMBOL calls only PIT, 

draws the* lix(Ki d(»(in4al equivalent of th(* int(*rnal 
tloaring p'oinl number NUMBER calls SYMBOL 
yvhi( h c alls PUT, * ^ ' 



LINE: Idiots a series of dalt^ pomts ciefin(*d by X and V, c on- 

/ rie( jing fhe points with straight lines if rcK|uesl^»d, It 
rfiay call SYMBOL as well as PLT, .i r ' 

SCAiE: |('\amin(*s a data array, to determine* optimurt> start- 

Zing valCie in a scaling factor tor use by AXIS and LINE 
in ( onverling dat^j units to plotter page dimensions. 
^' it IS ()n(* of the subroutine's (hat does not call any 
/ {)lhc*r routine. - 



AXIS: 



B(.NP( 



draws an axis lin(* with the appropriate scal6 an- 
notation and title anctuillfv-SYMBOL and NUMBER 
^as w(HI as PL T. ' 



be);ins plot. 
LNf)Pl F: 4 'ends plot. 



Treatment by Blocks— ANOV A - - ' 

This analyj^is is perform(*d only by program XC^OLIPS, XGROUPS 
c lassifies itJi aptitude into high and^ovy cat(*gorivstt<MC h containing 
(»c|ual numb(*rs of ex(r(*me cases. The analy*^s yields mean squart^s for 
tr(Mlm(»nls, kwc^ls (high vs* K)w c al(*g{)ri(*s^, treatmc^nt- by levels and 



O V^' --^^ * A ' 



>^.v / /esMuaherfor. Jhe /-ratio for treatment by levels is the test for .aaap- 

/t^^v- - "~ ^' " • ; ^ / . • - ; 

- : ' . V ' • . : - . ^ ^ 

€stimaie statistical Power , ^ , c . , 

' rirhese-^^culations also are made only by program XGr6upS. _ ^ 
^ . *,^CROUPS calculates the statistie.aLpow(?r [1-^0) for the.main effecrts ^ 
. -X {|eyels~^andjlfeatraents),and.inieraCtion ae \j 
, Ireatmeni^hy^bloQk^ AHOVA/ Power is calculated with fuhttibn , - 
' . which provides power estimates corresponding' to Coheri^s, : j 

[ ->v. ^ ^(1969? tabled values for differing valuesp^ (1) degrees of freedom in'^. j 
rr-^v w . the denominalpr 9f the f-ratiq, 0 cell frequency and (3^ the P-ratio 
required f^r significance "'^ 

' '••Stfrnfrtary <- * <^ \ _ .■ , n V.- ' • - " "t, - - • ^- 

" '•]■ ' ^ <• ' \ . ", ■ 

, 4f\e sequence of steps and outpul for the programs in this mailual'is 

Summarizetf below,. ... . ; - c 



it ^ 
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• Cajl^pul i^ubroui me CCD . 
. '■ " 

subrouuhe AMISOAT 1 


X 


- -H 






X' 


X 




X ^ 




• 

* X 


X 


X 


X - ' 


tpis.'ho(2i.5>gonciiy' of 


X ; 


X 


X . 




inlefcei)^ANCOVAJ 


. X 


w X ' 


X 




'Deflno^» po(nltsJ/imc» ' 
of inu'fsoaion 


t ' 


X 


X 




Plots fi^ton^l;./;' 


X 


^ iX ' 


X \ 




Per f( jf^its amaimepi'-by-^locks ' - 
AKOVA ^ 








.A 

X 


Isnmaivs^MlfsUtAl power 








X 




14 








' If " ' 


7 




\ 

t * ' , . 


* 



rrsidual error Ilu» / fcUio tor Uralnirnt by lrvi»ls is \hv U»s( tor an af)- 
Ittudr-treatnM'nl inlrra'( lion . 



€stimate Statistical Power 

Uusc (al(ulalM)f>s also arr made only by [Ko^rani^ XCiKOUPS 
' X(,K( )UPS c al( ulairs die slat istu al ()ow('r ' / /i) tor ihr main (^ttoc Is 
K and trcatnu'nls^ and inU'fadion 'Irvt'ls l)v trcatnirnls) lor ihv 

irralnu'nt-hv-bloil^*) ANOVA Power is ' c^k ulaU'd vvtlh tunidon 
POVVIK. vvhu'h f)rovidi's pnwvr rshniatt^s M)rrrs|)()nding to ( oh(*n's 
0 tahlt^d values tor (littering values ot ' P degrees ot tre<sJom in 
the denoniinalor ol ihe /-ralio. i ell tri»(iui'fu v and ' ^) the Philio" 
* re(juirc»(l t4)r signttu anre, . 

Summary * 

[he se(|uen( v oKleps and outf)Ut tor itie progrartis in this manual is 
sunimari/ed helov^ ' 



Sr(jlH lu r nl SU'J>N .UhI ( )utf)ilt \ 1 II IM \ll|l\J 



( .»!|n irijMlt Mlbl' KJtlfU' ( ( [ > 

MihfoiHifM .\\\lsl )\i 
( .lit ul.iti'N sutiitn,if\ 



|«>sN h' mil »t;« tn'iU « )t 



or inlrrs^i In >fi 
Pints r('v;ii)nN 

Prrh )rr]iN Irr.itfUi'nt \)\ l>li >< k'' 
\\()\ \ 
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CHAPTER II 
SYf^ COISMROL CARDS 



The outline below presents the sequence and description of the 
system control cards required for submission of the programs to The 
University of Texas at Austin Computation Center Other users will 
need to adjust this sequence in accord wfth the requirements of their 
particular facHity., Figure 1 (p. 1 4 ) reiterates the control card sequence. 

1. User identification card 

2. Password card ' 

3. Job card • • 

* , ' %, 

4. BSTAT Macro card ^ 

5. 7/8/9 card 

6. Prograrri buffer card 

7. Call program card ^ 

8. 7/8/9 card ^ 

9. Program control cards and data 
10. End-of-file (EOF) card 

7. User Identification Card 

I' 

Col 1-7 user number assigned by Computation Center 
Col 8 * comma 



Col *i-28 user's name (as many columns as needed) 



• ' 2. PasswoiTi Card | 

Col 1-3 password (imtially asstgfied by Computation 
.Center)' 

Col 4-13 "=PASSWORD/' . \ 

1 lob Card 

Col^3 /"JOB'* 
Col 4 Comma 
^ yi. Col^5>10 ''TM^OIO" (time limit in seconds) 
Col 1>1 cohnma r 
. Col 12-17 "PR=100" (print limit in pages) 
Col period 

$ ' 

These limits may be omitted (with the preceding comma) if the 
vafue to bfe us%fJ is less than: ' 

8 seconds of* time , * . 

17 printed pages. ^ 

The example limits may be increased as needed. If the default 
iVmits are accepted, the JOB card may be omitted, 

- 4. BST AT Macro Card - . ' ' 

Col V-23 "EXECPF(2350,STAT,BSTAT)" 



5, 7(819, - , . ^ 

This card contains the numbers 7,8,9 punched in column one. This 
7/8/9 card separates the preceding systerr^ control cards from the 
-_-^^^.?quent FORTRAN program cards (cards 6 and 7). 

tHJC 

17 ... 



The w cjra SllfC T >'^'-. rt2 r C "5 Toe D-rve-- -^eqi^ res -o' tne 

The nirnt>er ana r*T>e o' bu^t^i- i^- be drrrererv: -rcr *'aih program 
*e4eLted Tnere^urt lne.'u^l^4^ n§ :at?te 5.hcr-tid be corb.aIt€fd jn conrv 
piein:^ lh?s card 



Col 7-13 ,?20CR'V»V 

Col 15-^ ^IrCT^ 

Col 22-72 burer> • ' 7 ' 

* * 

Example > ' " ? 

-PROGRAM StliCT jSPLTOLTPLT,PLOTTA5^7 =?iOTJAPE15^\l 

7 Caf/ Prc>gf2n7 Ca»^ • , • 

Fni^ caJti elso beg^ n' Col and »s*u^ to call ^ pfograrn ^ 

, . Col 7-10 'if CAU \ * . 

. ' i 

Col 12-18 *naTr#e or pro^^am • 
'i^Col20 * 5 * . c' 



c5 22-24 t-vD 



i^ . . ' • 18 - 



6, Program Suffer Card . ' 

This card begins in Col. 7 with the word "PROGRAM*' followed by 
the word "SELECT" (starting in Ct)l. The buffers required for the 
desired p/o^ram^^Ve then listed in parentheses istarlhg in CpL 22). 
The number aad type of buffers w*ll be different for each program 
selected. Therefore, the following table should be consulted in com- 
pleting this card. 



Program 



Buttt'rs Rvqujred 




INPUT,6UTPUT'PLC)TJAPt7=PL()TJAPtl5' 

UT,()1>TPUT,PU)T>APE1S) 
INPUT.OUTPLtT.PLOTJAPnS) 
INPUT,OUTP;jTJAPF15' 



Col 7-1 3 '^PROGRAM" 

Col 15-20 "SELECT" 

Col 22-72 buffers . ' ' 

♦ k '■ 

Example: ^ - 

-PROGRAM SELECT (!NPUT,OUTPUT,PLOTJAPE7 - RLOTJAPE15)" 



7 Caff Program Card 

. ^ ^ "v. 
This card also Ijegins in CoL 7 and is'uSed to call ^e program 

desired. ^ 

Col 7-10 \| "CALL" .. . . - 



ERLC 



name ot progj-am 



Col 12-18 
^C(")l 20 
Col 22-24 "END" 
Example:. "CALL ATILIN1 $ END" 



1 1 
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a: 71819 ^ 

This card contains the numbers 7, 8, and 9 punched in.column one. 
This 7/8/9 card separates the preceding FORTRAN program cards 
from the subsequen^^ program control cards. 

•» ♦ 

9.1 Program Control Cards and Data 

S^he pWram is contrblled with the following cards which are 
specific to^ach program. Chapters III, IV, V apd VI of this^nanual will 
explain the preparation of these program control cards. 

Alphanumeric title card 

Parameter card(s) - 

F-mode variable format card for Group 1 indicating locations on 
data cards of relevant aptitude(s) and criterion 

(Group 1 data, aptitude(s) first and criterion second) 

. F-m^de variable format card for Gro«p 2 indicating locations on 
data cards of relevant aptitude(s) and criterion 

(Group 2 data, aptitude(s) first ahd criterion second) 

. A separate set of program ccaffitrol cards is required ^for each problem 
to be processed. Data for all problems must be included with the pro- 
gram control cards for the first pro^lem.Xroup 1 data for all problems 
follow the Group 1 format control card for the first problem. Group 2 
. data for all problems follow the Group 2 format control card for the 
"first problem. Program corrtjol. cards for addjtional problems follow 
the Group 2 data-. A blank tard is inserted after the last set of program 
control cards. The sequence of program control cards and .data is pre- 
sented in Figure 1. i\fofexthaJ all problems submitted within a single 
job must concern the s^pne pair of treatment groups. Problems involv 
ing different pairs^of* treatment groups must be submitted within s*- 
arate jobs. 

Data organization. Data should be arranged! by subject wit>- 
ment group with all of the data for Subject 1 'preceding th 
' 2, etc. Within a subject's data, a predictor (aptit 
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must precede any critecion variable included in a problem with that 
'predictor variable. The predicton variable(s) anckcriterion variable ap- 
"propriite to a specific problem ate determined by the format cards in-/ 
eluded in the program' controLcards for that problem. 



10. EOF Card 

The numbers 6, 7, 8 and 9 are punched in column one. The EOF 
card indicates the end of a job. * , 



20 



fOF. 



(17) 



Blank'df there are no further problems) 



1(16) 



MCards 9-11 and card 13 are repealed for each additional problem) \l5) 



Group 2 data (for aH problems) 



Formal card 



Croup 1 data (for all problems' 



Alphanurhef'fc title card 



7/8/9 



Call program card 



.Program buffer card 



7 8/9 



Macro card 




job c ard. 



Password 



User identification 

/ Figure 1. System and program control card arrangement - 
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(13)1 



(12) 



^ Format card 


^•(11) 


/ Parameter card(s). 


no) 



(9). 



(8) 
(7) 
Ife) 



(S) 



(4) 



(31 



(2) 



(1) 



* 



CHAPTER ill 
ATILIN1 



Program Description 

' . ' 

This- program tests homogeneity ot -gfoup regressions and defines 
regions of signif icanc e for the case in which ^here are two treatment 
groups and one continuous aptitude or^trait that is linearly related to 
a criterion. Program outputs (1) table of summary statistics group 

- sizes, means, stahcfard deviations, and correlations between aptitude 
and criterion; (2) re^r^ssion equations ( V-intercepts and regression^ 
coefficients) for each grotfp; (3) the aptjtude value at which. ^rouf3 

. • regressions intersect; (4) T-value, decrees pf freedom and probability 
for the homogentiity of group regressions test; (5) f-value, degrees of 
freedom -and probability for the test of cortimon intercepts (analysis 
of covariance); and (6) aptitude values for which treatment groups 
" are* significantly diffc^rent (regions of significance). A flow chart for 
program ATILINI is presented in Figure 2.^ 



- Program Input . ^ " 

'Card 1 alphanumeric title card Col 1-80 

Card i^t pararrieter card 

Col 1-S N for Group 1 (maximum = 200) 
Col 6-10 KJ for Grc^up 2 (maximum. = 200) 
Col 12 missing data option 

• ' . 0 = all data valid 

. 1 = blanks are invalid 

2 =^lanks and zeroes are invalid 
Cori4 output option 

^ 0 = plot 

*1 =film ' 
^ 2 = printed output only 

' Col 16 ^ option for table of predictor and cri- 
terion scores listed by subject withm 
treatments. If this option is" taken. ID 

ERIC 22 — \. 



—HZ 



1 " 




T 





5 




4 









AMHOaT' D«l(r«« (nvilli tni/nt nltslni 



• figure 2, Program ATILIN1 flow chart. 
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Card 3 



Card 4 



C0II8 
Col 20 
•Col 25-34 



codes wjll be read according to format 
and will be printed out (A5) along with 
corresponding predictor and criterion 
scores for subjects in each treatment 
group. Subjects with missing data will 
not be lifted in this table.. ^ ^ 
no table 

1= list ID codes and scores (begiii 
format cafds with A mode field)* 
Qa of <:ards per subject in Group, 1- 
no^^f cards per subject in Grouj^^ 2 ^ 
alpha level for regions of significaqi^fe 



format for Group 1 Col 1-80 
followed^by Group 1 data 

format for Group 2 Col 1-80 
followed by Group 2,d^ta 



Card 5 blank (after last problem); 

for multiple problems repeat cards 1-4, omitting data 



(A5 or less) for the ID code and then^the tv\o F-mp^e fields 



Data cards should contain subject ID co^j^(if desired), the ap- 
titude score, and then the criterion score. If Col>6.^n the parameter 
card is 0, then forhiats must specify two F-mode fieldWthe first field 
for the aptitude and the second for the criterion. If Col 16 on the 
parameter ca^Lis 1, then formats must specify an initjil A-mode field 

_ X,:, 

Example Problem 

Data for this problem will be the first predictor 
as sample data in Chapter VII (p-95) of this ma 
cards for this exlample problem are as follows. 

1. Alphanumeric title card 




erion given 
Vam control 



/ 



Example problem for ATILINI 
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2. Paramoter card 



/ 



0005000050 D'O 1 1 1 .05 



.3. Format card for Croup T 



(A3, 1 X; F2, 2X, F2) 



4. • Group 1 data 



5. Format Tard tor Clroup 2 



(A3, 1X, F2, 2X, P2) 



6, ^Group 2 data 



7. Blank card (aftcrlast pfoblerri} 



8. EOF 



/T 



8 
9 



-7^ 



P/inted output tor this example problem is giveain Figures 3 and 4 
Plottt^d output is given in Figure 5. * 
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nABLE 0P*»PR5DICT0R AND CRITERIOM SCORES I.ISTED BY SUBJECTS WITHIN 
"TReATMENTS \ * 



tre/Ctment 








PREDICTOR* 


CRITERION 




10.00^ ' 


^ 5.000 




15.000 


^ 15.000 


bS^V * 


20.000 


15.000>. 


004 


?5.000. 


20.000 


' 005 • X 


d0.000 *■ 


' 20.000 


006 ] 


20.000 


25.000 


' 007 ^__/ 


35.000 


2 5^.00(9 


008 


40.000 


25.000 


009 ' 


30.000 


' 30.000 


010 


40.000 ' « 


30.000 


011 


- 50.000 


30.000 


012 


25.000 


35.0Cf0 


013 


30.000' 


35.000 


014 'i 


45.000 


35.000 


015 


55.000 


f 35. 000 


016 


35.000 


■ 40.000 


017 


40.000 


40.000 


^ 018 


50,000 ^ 


40.000 


019 


35.000 


4 5.000 


020 


55.000 


45.000 


021 


60.000 


45.000 


. 022 


65.000 


45.000 


023 


40.000 


50.000 


024 


43.000 


50.000 


, 025 


50.000 


50.000 


026 « 


60.000 


50.000 


027 


65.000 


• ' 50.000 


028 


70.000 


50.000 


029 


50.000 


55.000' 


030 


50 .000 


60.000 


031 


55.000 


60.000 


032 


60.000 


60.000 


033 


* 65.000 


.160.000 


034 " 


70.000 


60.000' 


035 


75.000 


60.000 


036 


'60.0^0 


^ 65.000 


037 


70.000 


65.000 


030 . 


. 80.000 


65.000 


039 ^ - 


60.000 


70.000 


040 


.65.000 - 


70.000 


041 ; 


70.^00 


70.000 


042 


7 5.000 


70.000 


043 


85.000. 


70.000 


044 M 


70^000 


75.000 


045 


80.000 


7^.000 


046 


75.000 


80.000 


047 


85.000 


80.000 


0^8 


90.000 


80,0^90 


049 


8§.000 •<- 


^ 8 5.000 


050 ' 


90.000 


85.000 



t 




figuri> \\ PnnU'd ouipul ioiATILINl example problem — uMvofprc- 
' diclor and crilvfion si orcj>. 
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TREATMENT ^ 



ID 


Predictor 




051 


/ 0«000 


70.900 


052 


/ 5 , 00(2) 


65 .000 


053 


5 • 000 


75*000 


054 


i0«d00 


75*000 


055 


/ 15 • 000 


OKI . vmv 


056 


/ 15*000 


70 000 


057 


20.000 


r 3 . 10 1010 


05B 


I 25*000 


37* 101010 


059 


/ 2 5. 000 


7fll 01 01a 
«(0 . 10101ft 


060 




OtO* I0I0I0 


061 


30 * 000 


.65.000 


062 


30*000 


75 . 000 


069 


35*000 


50 . 000 


^064 


1^5.000 


33 . 10 1010 


065 


40. 000 


A0 000 


066 


40*000 


70. 000 


067 




75.000 


068 


45*000 


55 .000 


069 . 


45*000 


65. 000 


0t0 


50*000 


45 . 000 


071 


50.000 


65.000 


072 


55.000 


40.000 


073 


55.000 ' 


50 . 000 


074 


55.000 


55.000 


075 


55.000 


70.000C 


076 


60 . 000 0 


55.000 


077 


65*000 


30 .000 


078 


65 . 000* 


40 .000 
65.fi)00 


079 


65*000 


•080 


^ 70.000 


t 25.000 


081 


70*000 


35*000 


082 


70.00f) 


49.000 


^83 


70 . 000 


it K ana 

3 3.101010 ^ 


064 


70 j^flft 


A0 000 

OKI . KIKIKI 


085 


75 * 000 


901 0I0I0I 
CKI . I0I0I0 


086 


75.000 


30 . 000 


087 


75 . 000 


A^0l 0I0I0I 


088 


75. 000 


0I0I0I 

310 * 10 1010 


089 


80*000 


15.000 


090 


80if06^ 


4Si.000 


091 


80.000 


55.000' 


092 


85*000 


10*000 


093* 


85.000 


15.000 
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Figure \ icoruinucd). Printodoutput lor ATILIN1 example problem 
^ table ol predictor and criterion scores. 



MHhodologtcal Notes* 

fo test th(» [ivf)()lh('sis thill tfu* rc^rcssio'tis tor two groups art* paralU*! 
■^1 (♦ , the slopes arc ('(juji ' A 1 1( l\ I ( onstruc tvii standard !Mix\u))r(»di( ■ 
tion model of tfic torni-- 



111 



. \ "\ b(Mfi^ \\}v total rntnihcr ot siib|^(»c(s m b^)th groups); 



rs( 



vv[i(»re IS \hv (ntcrion. I) j is tnr*t(»^r('ssu)ii (otMluKMit lor th(» f i 
^r()U[) nicnil)crs[itp v('( tor, V^^tstorcd I tt is in droup I,s(or(»d() tt 
not'r /) the r('^r(»sston (octticicnt ot a sciond j^roup m(*nib(»rslnip 
v(»ctor. \ 's(nr(»d 1 tt ts m Ciroup 2. stored 0 it not>; h [hv r(*^r(»s- • 
sion c{)(»tti{ i(»nt ot th(* product ot Xj^ and lh(» aptitude vector (this 
product syniboh/ed as \ , and l)^, ihv re^rc^ssion c oc»ttic i(»nt ot the* 
product ot X ,^ and the aptitude v(\tor (this f)roduc t symboli/cni as 
X, 



The* rc»sidua+ sum ot scjuares ilep has de^rec^st)! trecuJom ^Iven by 
the* number of Ss minus the* numb(*r ot linearly tndei)endent 
paramc'ters. ThVretore. wc* have* \ 4 dt or, tor more* than two treat- 
m(*nl groups, \' - '2k (it. \vh(*re k (*quals the number ot trcMtmc^nt 
groups f 

To t(*st that /) ^ ~ h y I.e.. that the* rc^^resslons arc* homogeneous, 
the (lata arc* tittc*d to ii s(h one! more* rc*stric ted modc^l whic h repre- 
sents f>bsc*rvatlons within c*ach trc*atment ^roup about regression 
linc*s with a common slope*. This re*str(Cte*d model is of the lorm 



*For c*x[)lanatc)ry purpose's, mc^Niiodologie al ne)le*s may re*tle*ct alt(*r- 
native* but mathematically icic^nticM procedure's to those actually 
emf)lc)yed,by the* programs. 
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§r^*jrp> St^ie 'es*ni"-^-d niXieS 12. w J^binrt^ pr*-dn.Vj(r ianabie^ 
greare? than it"^ The5« Mif-K^je^ uin be t^jucJ 't the r^uiJ m- 

c anno? be than 

tormed, given b* SS^'^^^ = 7 - ie7 wjth v - j: - % - 4, = 7 -d? 

or. tor modeh w rth tf^^trnral groups- il * 7 c?' The f-!«^t* tot 

honv^ge-ne^jv f lopes 7< then ^rven bv 

55.^/'Ji-7* 



1 



'This f-leS'l i'lustt^t^ the gene<d n^'Thtjd ^J7 *»§nrt*i4sm^ te^T^rig 

prrxfeds* atcdrdtn^ lo the lolJoAiri?; steps r*T<t. a i^lanmg^ ur tuU 
fnodel i> wntten Sei»j»nd a T€»strni<#on rt^ew^sni to the h>pf^theMS ul 
^nieresi'^ ATitfen T^,^ <a res! m led m^jdeJ ^^ : farmed b« A oTpoj^ti- 
*»ng this res,!ntf«>n ^niv The f»*!i model Ttjunh tht- h>p^!hesi»» Mim oi 
squares . ^s turrricd bv i^ubiraiiina ^he tuH model frror sum 

5<^res ^^jj^i^ J^-'^ resimtcjj model err»x sum squares 
'5S^^^^^ The d^ref-s o? treedom Tor SS^,^ equal The: degrees <5T 
tfeed»>m Jor ^^f^frd degrees /TC^dom !of 35^^ Fftlh. the 

f-Tes! ?of the hvpo]ise$^s ot merest /5 gr^'en bv c 



or dliornalivi'ly <^ 

where is the vector ot af)titucle scores for the residual sum ot 
squares f) we have \ - i dt or, \in more than two treatment 
groups, \ - k ' L dt, where k ei|uals the number ot treatnK'nt 
groups. Since the restricted model [21 combines f)redictor variables 
lreal<»d st^parately in the starting model HI, i.^," is expected to be 
greater than-le"^ These sums ot sc|uares can be equal it the null hy- 
polhesis is true (i.e., it grouf) regessions are homogencH)Usi. but 1/ ^ 
cannot be less than le^. 

To tc^st for homogeneous slo[)es, an hypothesis sum ot squares^is 
formed, givc*n by '^'^/^y^ = ~ ^^7^ vvith <N - i) - iN - 4) = 1 df 
or, tor models with A trcMtment groups, k - / dt. The T-test' for 
homogeneous slopes is then given by 

F(k - IN- 2k}^ 



Icf / (N- 2kf 



*This f-tesl illustratc^s the general method for significance testing 
within the context. of multifile regression analysis. Significanc e testing 
()roccvds according to the following stef)s. First, a starting or full 
modi^Ms written. Second, a rc^stric tion relevant to the hyfiothesis of 
interest IS written. Third, a rc^stricted modcH is formed b^ incorporat- 
ing this restriction into the full model. Fourth, the hypothesis sum of 
squares ^^^^y^^^ formc^d by subtracting the full model error sum of 
squares ^^^f^jj^ ^rrmi the restrictcvf model error sum of squares 
^^^r\trd^' degrees of frc^edom for ^^^yp ^'qual the degrees of 
frei»dom for '^'^^^^^^y r7iinus the dc^grec^s of freedom for ^^j^^jj- Fifth, the 
r-l(»st for the hypothesis of Intercast is given by 

SS. /df, 
hyp' hyp 



'hyp^ ""'full^^SS^^^^/df^^^^ 



M caution shfHjIcI bv noKn) in the cast,> whore the dist lotions of 
# aptitude score\ tor the two groups \vtu\ to have restric ted overlap. In 
" such an instance, heh»rogeneous linear regressions tor two groups 
may simply MU»c t a ( ommon curvilinear r(»gression as in 4he follow- 
ing diagram 

Y 



In such a case, thc» homogeneity of group regressions test may be sig- 
* nUicanl but the conclusion that, group regressiyns <>ctually differ 
would Ix' err()ncM)us. The user should study the plotted output 
car(»fully tj) avoid sue h incorrec t cone lusions. ♦ 

2. Jvst (it Common Inlvrcvpls (Anaiysis of Covanam v) 
Jo test the hypolhc^sis thai two ircMlmenl groups are not significantly 
difterenl when subjects score at the mean of the aptitude, ATlLINf 
constructs a lull modt*! of ih^form 

where is the c riterion; h ^, the /egression c oefficient for the first 
group membership vec lor, X^^ (secured 1 if is in Group 1 , scored 0 if 
not); and b^, 'the rc»grc»ssion coefficient for the second group mem- 
bership vt»ctof, X^^ (scored 1 if 5- is in Group 2, scored 0 if not); and 
h^, the regression coefficient for the* aptitude variable, X^. Note that 
this model is identical to 12). The degrees of freedom^for the residual 
^ sum of squares llc*^^) for this model are N - i or, for the case of k 
ireafmerft groups, N - k - 1. * 

To test for sij^nificant intercept differences, ATILIN1 constructs a 
sc»cond, ntpre restric tc»d model of the form 




where a is,lhe V-inler(e()l cind df - \' - 2. This r(»slri(led model 

results from pItU ing the restrutioh ora the full model, 

2 2 

An hyp<)th<»sis sum of scjuares <i./ , ^ ) and f-ralit) ar(» con-, 
struc tecJ in.lh(» usual mann(»r, using the (»rror sums of scjuares from lh(» 



tult and reslric led mo(li»ls 



i Romt of /n/ersec /K)n (Jvst ot Ordinality^ * . 

An aptitude-treatment inleradion is said lo be ordinal wh(»n grou[> 
regressions K riterion on a[)titu(le) ta^ t(^ intersect within th(» ob- 
s(»rv(»d range ot *i[)tJtu(le values and di^^urdiriiil wh(*n group regr(»s- 
sions do inlers(»(t w ilinn \hv observed" range ot aptilude values Or-^ 
dinalit/may bv noted from a [)lot ot ihv group r(^gr(»ssion lin(»s or 
from deterpiining the [)oint ot ,intersiV lion as giv(»n by , 

a , ~ a , 



where^a^ and ar(» th(» inler((»[>l and slope* tor ihe crilerion on ap- 
litudt* r(»gri'ssu)n i^jJit»-'ftfou[) 1 and a , and bj ar(» u)rr(»sponding 
values within (jrouf) 2, It tails within the range ot obs(»rved afv 
ritud(* values, (hen ihi* interaction is clisorclinal; otherwise*, the in-^ 
lc»rac tion is ordinal 

A region ot signiticance cl(»sc ribi»s a range* ot a[)litude variable valucVs 
tor which tliere are sfgniticant group clittrrc»nci'S on the, c rilerion — 
i.e , the distance beiwc»en th*e regrc»ssion lini^s is signilicanlly clittereni 
trorn 0 To identity regions ot signitic anc v, the* )ohnson-Neyman lech- 
ni(|uc* 'lohnson ^ Nc»vman. l^ib; )ohnson & jacksofi, is 
(employed All Values oj^the a[)tilude variable, tor whic h there arc* sig- 
niticant ditterenc-ev betwt»/'n grouf) rc*grc*ssi()ns (V^ - V^), arc* in- 



*T() av<Mcl contusion the reaclc>r should note that regions. r)t signiti- 
(an(i» as reterrecl to in this manual arc> mathc»matk ally detincxl and, 
4(her('t()re, may not necc^ssarily tall within thc> rangc> of data. 



eluded in regions of significance Wht^fi the difference*, - for a 
, single aptitude variable value is of interest, a t-statistic with 
+ - 4 df can be (om|)uted*as follows: 

D 



with D - Vj - \ 2 '^"^ 



D 



S2\ 



1 tcyy- ) + 1 [- J 

,= 7 \ Cxx /J [NjN^ ,= 7 \ Cxx^ /_ 



where / reefers to treatment group; and are the numbers of^&ub- 



C X X = 



je(ts in the two treatment's; 

IX^ - HX)^/N (sum of squares for X, the aptitude variable); 
* Cyy =^ lY^ - llVl^/N (sum of i^quares foe V/the criterion variable); 
jy^'xy = XXV - (^X)(i.yi/N (sum of cross products]; X* is the-aptitude 
val.ue at which we are testing the distance bt?twt»en regression lines; 
and X IS the mcMn of the aptitude variable. 

Bounding a[)titude variable values fxjr rc»gions of significance are 
obtainc»d by solving the equation 

^ ' -B±\Ib^ - AC 



where A, B and ( re^present terms provided by Walker and Lev (1953, 
p. 401). The (equation fof'bouhding values gives two (real^^ljons 
when B^ - AC is greater than 0, one real solution when|(r*^^C is 
exactly c^qual to 0, and no real solution^ wh^n B^ AC is less than 0. 
A bounding va^ue separates a re^gion of Mgnificance from a region of 
nonsignificance. Consider an obtdined\bbunding value, k. Does x 
re»pre»sent^ the upper bound of a region of significance falling below it, 
or the lower bound of a region of significance falling above it? the 
point of inlerse^ction can be used to- determine which alternative 
reflects the true slaU» of affairs. At the point of .intersection, the pre- 
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(Iided (rilerion (liltcrtMu (» l)(Mvve(|n th(v ^r()U'p^^ is 0. Such a /oro 
(littercfKr can never l)e (^jnlairyt'd within a re^l()n ol smniticant 



ditteroiues -That is, the [)()irrt ot 



inie»rse( tiori always- lies^jfUf^iihin a 



remoti of nonsi^mtu aiuir It die )(>inr(>t intersedion talK^ in the 
re^l(>ll below a l)ounding valuo. ttieti tlial b()und^n^ vatue is the 
lovv(»r bound tor a re^l()n ut ^igniti[an(e tailing alM)V(» it. It {\w points 
of inlersec lion tttlK in the region above die bcRjndir^ value, then thai 
bounding value is the upf)er ^"rwy^nc^i t(jrjy;^i*f7Tfot signihianc e tailing 
below a ' ^ ' 

Consider the location ot regiif)ns of significance when no bounding 
values tpxisr In this case, asirlgie region exists — that region extending 
trj^^m -oo to +00 on the aptitude variable. Given that the group 
regrc'ssions are not exac tly parallel, then this region contains an inter- 
sec lion and il is a r^^gion (7i.ir>6'nsignific ante. As a j^enoral rule, a lack 
ot bounding values indicates ino regtons of significance.* 

The location of .regf(>ns of, significance when a single bounding 
value IS obtainc^d dc^servc^s little* attc^n^ion. A single bounding value 
ri»f)rc*senls a highly im[)r()bable case — the term B - AC in the 
bounding value equation i^^G'xac ily ecjual to 0. The improb^xbility o^ 
this situation is mate hc*d by a pec uliar region of significance. 'When a 
single bounding value exists, then that single point is the entire 
rc»gion of significance with j;c*gions of nonsignific anc e falling both 
above and below it. 



' *An ex^ceplion to this rule occurs whc^n thc^^'group regrc^ssions are 
ex,ac//y parallel. Parallel regressions produc e no intersection, and the 
single regioji may be eit'fter a rc^gion of significance or a region of non- 
signiticanc.e. This, exc option is of,l-ittle or no importance for two 
' reasonsj* First, exac tly parallel gr(?up rc^gressions are highly improba- 
ble, and\e^(ond, the Johnson-Nc^nmn-^hriicjue is not intended for 
use when groyup regrt^ssion^ are homogc»neous. When regressions are 
homogeneous, simple analysis of cx>variance provides an adequate' 

" s 

analysis strategy, ; . - 
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Wh(»n ivvu bounding v.iluf> arc obtaifit'ci then cither one "or two 
regions significance extst. [vi represent the lower ot two bound-* 
ing values, and x^^ the higher ot two bounding values. It rhe'tntersec- 
tion falls between x^ and then two regions ot significance exist — 
ono region extending from - oc5 to x^, and the other region extending 
from x^^ to -f oo. If the intersec tioi^.talls below x^ or above ihi'n a 
single region of signifu ance exists wilh^x^ as its lower bound and x^^ 
as its upper bound. Figures (xa and 6b illustrate one- and two-region> 
cases, , * . 

The occurrence ot a single region of significance may at first seem 
counterintuitive. The rc*gion of significance in Figure bb has x^ as a 
lower bound. It may appear that this region sh(iuld continue below ' 
x^, since the distance bewcVn the two rc^gression lines incre'SS^es, 
F^oweveJ^ the test of signifi(ance involves not only the. distance bet- 

* wc»en the rc^gression" lines, but also the standard err'or of thl.% dis- 
tance* — i:e,, / = O/^p- Given that D is increasing, it- is not nec essary 
that / also be inc reaslng. If D and .S^ are both increasing, and if 5^ has 
the highcT rate ()f in( rcMse, then / will be decrcMsing. Such a^uatiDn 

" occ urs in the one-rc^gion case. 

Co'n si deration ot^ confidence intervals around the group regression 
lines may be helpful in clarifying the single-region case. The following 
diagram represents confidence Intervals for V construclc^d about the 
regrc*ssion of r^>n X. 
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Figures ba and bb. - Cas(vs ifi\'olvin^ one region (b) and two regions 
'fa) o/ sif^niiiccincv Shaded areas reflect regions 
of significance: Xq indicates the point of inter- 
section while X-j and X2 indicate ^ obtained 
hounding values for regions of significance. 
Two regions occur when X-j and Xj straddle Xq 
J.nn one region occurs if both X-j and X2,^a//'/o 
'one side of Xq. 

30 , . 
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The Straight i^^Wd) line represents the regressiorvline, while the hy- 
perbola (broken lilies) depicts the confidence bounds. Note that the* 
confidence limits are narrowest at the mean of X and expand as one 
moves away from Fin both directions. Figure 6c presents the single- 
region case With confidence boundaries included. This figure demon- . 
stl-ates the plausibility of,'the single-region case.. 

Statistical texts {^,g. Johnson & Jackson, 1959; Kerlinger & 
Pedhazur, 1973; Walker & Lev, 1953) whicH deal with thejohrtson- 
Neyman technique have not considered the single-region case.While 
such an oversight may lead to.confusion on the part of the researcher 
who does obtain a single region of significance, the importance of 

Ijch an oversig^ is mitigated by two points. First, the single-region 
f^se does not occur with great frequency and, second, the single- 
region case may actually be somewhat* of an anomaly. 

Toiilustrate these two points, consider the dptitude-treatmenl in- 

^leraction results reported by Borich, Godboul, Peck, Kash & Poynor 
,11974}. Thes^e authors report 107 significant aptitude-treatment m- 
teractions, as evidenced by heterogeneous group regression slopes 
•Vignificanfat tho ,10 l^evd^ Regions of significance analyses were 
computed for each of these 107 interactions. The significance level 
- employed fli these latter analyses, was .05,>Of the 107 significant in- 
leractions,j)nly 13 yielded a single region oi significance, while 61 
produced two regions, and 33 produced no regions. Of special Tn- 

31^ 



Figure 6c. Confidence limits in the single-region^ase. The heavier 
lines represent Group 1, wh/te the lighter lines represent 
Group 2. Solid lines are regression lines, while the broken 
/vpes are confidence' limits. The confidence interval^ . 
* around the two regression lines overlap except in the 
shaded area; thus to ^2 constitutes a single region of 
^ ' significance. 
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leresi herj^.is the fad thai a// analyses which involved group-slope 
differences significam al or beyond the ,05 level produced two 
regions of significance, while all analyses which involved group slope 
differences significant between ,10 and .05^ produced either a single 
region or no region. Thus, a singte region'is obt^iff?a75nfy\ii£n the ^ 
difference belween group regressions is marginally significant. These, 
results also allow the speculation that a single^ region is obtained only 
•when the chance probability of the difference betw^een group regres- 
sion slopes is nui^rically greater than the significance leveLchosen 
for the regions /)f significance Analysis, in^other words, it is possible 
that jll setting the same significance level for both the homogeneity 
of group regressions tes4 and the regions of significance test aticJ (2) 
/applying the latter test only when the former is significant (i.e., When 
\hei'e is acceptable evidence f6r the existence^of an aptit^^e-treat- 
"menl interaction) vvill elimin5te„the single-region case. 

Impgnancr 6t a Region Of'^Signiiiiyancv in . ^ 

thv S'mf^lc-Aptitudc Case 

' the existence of a region of significance does not necessarily indicate 

yhc practical importance of that regic^n. for example, if a region of sig- 
nificance c()htains nc; observed datJr^;D(^s, then that regionis 6i lit- 

^ tie importance. (Program'A'TILINI only replorts regions of -significance, 
which fall within tht>- range of the observed data.f Furthermore, 
' regions' of .significance are established on the basis of general'relation- 

. ships observed across ., tht^ entire ran^e - of dptrfude values. The 

)ohnsc)n-Nc-yman lechniqae defines a regioh of $ignif Usance in terms 

- of differences between group regressions (predictOicI vatues) and not 

* 

on the basis of the observed data^within that region. The actual pat- 
lem of obsei^ved results within a region of significance may Be in.con- 
flict with the generaj prcKiicted r(.>fationships, and. if? this case the 
re^iotn would be ^riittle importance. Figure 7 presents a simplified 
^exariiple of tbis latters'ituation. N^bte in Figui'e 7 that theJeft region of 
significance (below point A) is evidenced because the Trj^atment (J 
re^gression line {f)redicted scores) is significantly above the Treatment 




. " ^'^ - * ' J, 

Xregressfon line {predicted scores), the left region of significance ; 

would usually be taken as a regipn wher^Treatment O vv^s superior. | , 
Npte,!h.oy^ev^r,Jthat;the bbserved.data \vithin this re'gion indicate Jtbe ^ 

exact oppqs/te relat.ionshi(>. Any conclusion about the superiority of . I ^ 
Treatment O/Wiihin that re§ion"is qgeStionable/ f ^ 

A general ppression oJf the im'pprtance of a region of sj^nfficance 
can be obtaflned by inspection of the plotted output from Prograrn 
ATILIN1. If only asmall amount^pf data is conjtaihed withtn a region of 
significance, jthen this will bd#LVjdenced in the plot. If the pattern of 
observed results within a region of signifijcance floe^n't reflect fhe 
genera!f)attern of results (Ke., the overafllinear regression lineshthen 
' this also should be observable in the plot.^ ^ 
.While plotted outj^.provides^eneral impressions about the im- 
^ port^nce of ajegion of sjgnificaqjj^nibre objective measures pf '^♦^ 
portanceare often desirable. Tw^o.rrfeasures of the importance of a 
region of significance can be calcufated—(1) the proportion of total ^ 
.obser>;ations wfthin a cegion of significance and* (2) an index of the 
ovefjap within a region. While ATILINI does not provide cafculatioris 
^ of thes$ nrieasures, they can be easily determined frorn^ the plotted 
. putput./ \ ' . ^ 

Proportion total observations \yithm a region of significance. This 
index of importance is simply the number of observations fajling 
within a region divided by the total number of oteervatioris. The 
greaterfliiV propo/'tion, the greater the importanceif the region.of . 
significance. ^ / >/ ^ ^, - , 

Index ot overlap wittiin a region of significance. Gjven a region &f 
significance, we cannot be certain that j|py given S {n the group, pre> 
dieted to be superior actually t^erformed betfer than all the Ss in.the^^.^ 
other group. Some.drpup 1 Ss will perforrp better "than Croup.? Ss'^r^*^^*^ 
even thpugf? the interaction ancf region of significance indicate- that 
*^foup 2!$ treatment was superior to Group 1's treatment in that 
region, figure* 8 illustrates such overlap in a region iof significance. 

■ ^ ; ■ : -,, ' ' ; -t?- -/ ■ . 
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X r<»gression line 'prt^didled s(()r(>s). The left r(»^i()n ot significance 
would usually b0 taken as a region where^Treatm(»nl O was superior. 
Note, however, that the observed data within this region indicate the 
exacj oppositv relationship. Any conclusion about the superiority of 
Treatm€*ni O withm.that region Is (questionable. • 



A general impression of the importance ot a region of significance 
can be ^btaini*d by inspcntion of the plottc»d output from Program 
ATILIN1 . If onlyXsmall amount of data is contained withig a region of • 
significance, then this will bO^»videnced in the plot. If the pattern of 
()bsi»rved' results within a |/egion of significance doesn't reflect the 
gerteral pat tern of results (I.e., the overall linear regression linesj, then 
tKis also should be observable in the plot. 

While^lottecj output provides gent»ral impressions about the im- 
portance of a rVgion of si'gnificancjcymore objective measures olf im- 
portarice are often dc*sirable. Two measures of the importance of a 
region of significance can be calculatc*d — (1) the proportion of total 
observations withinr a region of significance and (2) an index of the 
ov^»rlap within a region. While ATILINI1 does not provide calculations 

of these miMsures, thi7 can be easily det^ermine4 from the plotted 
«j ■ ■ * 

output. p ' 

Proportfop (^/ total ob^'rvati^ns within a region of si^nifK atin\ This^ 
index of importance is sirnply the number of observations falling 
within a region divided* by the total number of observations. The 
greater this pVoportio'n.. the greater the jmpcVtance of the region of 
significance, ^ 

Index of ovvrljSp withm a region of si^nifnamv. Given a region of 
significance, we cannot be certain that any given S in the group p^- 
dictc^d to be s'uperiorMctually performed blotter than all the Ss 'm the . 
othk group. Some Group 1 will perform bettc»r than Group 2 Ss 
even 'though the* interaciion and rc^gior^of Mgnificance indicate that 
Group 2's treatment was supeflor to Group 1's treatment in that 
region. Figure 8 illustrates such ovc^rfap in a rc^gion of significance. 
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Fieure 8. Overlap withm a region of significance. 



( Onsiclcr th(» Region ot signitu am v l)()uncl(»cl by f)(>int A in \ igurc* 8. 
Notice ihcll. (»vt»n though Fr(Mtm(»nl () is sufMTior to TrcalmorH X tor 
thc\u(M which li(»s to lh(» l(»tl of f)(>inl A, some' X Ss tall cIosit to th(» 
regression lin(» tor Tr(Mtm(»nl () than to thi» X rc^grc^ssion lin(», and that 
some (; Ss tall ( loser to the r(»gr(»ssion lin(» Tor Tr(»alnn(»nt X than to the 
() regression liniv We (an (»X|)e( t sue h ()V(»rla|)j)ing to occur (»ven 
vyh(»n r(»gi()ns ot signtticance al*e cletin(»dal a high lev(»l ot c onticfence. 

jKn index ot the extent ot such overlapping is the pcTc (»nt ()f all sub- 
jects tailing within a r(»gion ot signitic anc who actually ciemonstratc* 
a criterion score ipconsist'ent wHh thcMr trcMtm(»nt group. The smaller 
the value ot this ind(»x, the gr^eater the* imp(jrt«uic t^vut th(» r(»gion ot 
signiticance'Suc h an mdevcan be calc ulat(»d by counting ibv number 
of subjects in the region ot signitic anc (» who, while* assign(»d to the 
poorer trcMtment, actually performed above the* midline* betwe»e»n the 
re»gre»ssion lines tor the two groups a line* ec|uidlstant trom the 
two group re^gressions) and adding to this the number ot subjcr ts in 
the* re»gion ot signitic anc e* who,-^ while* assigne»d to the* be»ttVr tre»at- 
me»nt, actually pertorme*d bellow the midline* be»twe»e»n regre»ssions. 
The percentage ot both types ot deviations within a re»glon is calcul- 
ated by tinding the* micjline be*tweH»n the* group regressions and the»n 
Hie»le*rmining whe*the*r e\u h observation tails above or belo.w this line. 
Le»l \fp/iX^) symboli/e* the midline* criterion score tor a pre'dic tor score 
ot X^. Note' that IMpt^X^, \^\ indicates the set ofjooints tailing on the 
midlinev The midline between group regressions is given by 

7^ 4- b^fX^ - X^i - -b2 X^ - - 
\1pt(X ) = + + b^fX. - X^) 

or simplitying, 



+ b^fX. - X*) + ^tr2X. - X^) 



MpKX.) = 

, 2 
where V^. and hj represe»nt the criterion mean score, aptitude 
mean score and regression ( oettic ient. (c rite>rion on aptitude), respec- 
l(v^»ly, tor one treatment ancfV^, X^ and b^, these same values for the 
^ other treatment. For suhjec t n with criterion score and aptitude 



score \^^, ihc (lisiaiVic iromyrfir fnidlinc is given [)v 

I) will he /uro v\ fieri the ohs{»r\aliori tails on the niidiiru*. positive 
vvfien It talis al)ov(' if and iu»i».»tive wfieii it tails Ih»I(>v\ i(. /)'s tor of)- 
servalioos o! tfie f)elter (reatnielil .ire expet l(»d lo be positive and l)\ 
tor ohserva^iojis ot ifie [)oorer Ireattiient are e\p(»( led to h(» n(»galiv(v 
lx((»ptioris are (onsid(»red "miss(»s" and art* lalli(»(l and reported as a 
percent ot tfie total luiniher ot observations williin if^e region, In 
figure 8, two obsc»rvations iC)'s> troni tfu» t)(»tt(T IrtMlriuwit tell l)(»low 
t^iKnii(lliri(» and two observations ( X's) from tf^t* poorer IrcMtnuwK tell 
ab()v(» It Botfi types ot "misses" ( oiistrlult* JH p(»rc(»nt of lfi(M)Us(*rva- 
lions that lav wit fun lfi(» region ot signitic anc (». W(\ lfi(»r(»tore, would 
re[)(irl a 28-p(»r( ent ov(»rlap tor tfie ri'gion ot signitic anc v bound(»d by 
^ lhi» af)litu(U» vakie A. A sniall amount ot ov(»rlap indicates tfiat ifie 
r(»lationsliips among lf](* data actually observc»d'wilfitn tfic» rc»gion arc* 
c onsistcMil witfi [hv prc»cltc lc»crrc»laltonships usc»d to establisfi [hv c»xis- 
(c»ncc» ot if^al region ot signitic anc cv A large amount ot overlap indi- 
cates tfial tf^c» observed data c ontradic t tfie validity of a rc»gion ot sig- 
nitic ante*. Jhv greater ifie overlap, tfie* less the importance ot the* 
region ot signitic iinc e. 

It is inif)ortant lo note that a sub)c»c I from Trciatnient 1 scorifig 
c losc»r to the rc'gression line tor Treatnic»nl 2 doesjiot f)rovide Infor- 
mation as^) whether that subjc»c I has bc»(»n assigned to a trtMtmenl 
incorrec tly. This bee onies obvious when wc* c onsider a subjec I wfio 
assigned W the better trcMl merit within a rc*gion ot signitic anc c» but 
whose* <;c ore tails, let us say, at or below the* regression for the poorer 
tr(Mlme»nl in this region. Sue h a S may bc» alrcMcly performing the best 
that can be e\[)ee ted troni either of the treatments and plac ing hini in# 
the o[)[)osing treat merit might el(»[)ress his crjte>ripn score below even 
its present level. The investigator cannot inter thai tiu' assignment of 
()verlapf)irig subjects to any olhc»r treMlme»nt would necessanly bring 
the* data into [)c»lter fit With tfie overall regression lines. 
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Confidcmv mtvrwiis for the diitvrcm os bviwcon group regressions. 
Cronbdc h and Snow (1974) have developed an alternative procedure 
relevant to the importance of aptitude-treatment interaction results. 
Cronbach and Snow suggest the calculation of confidence intervals 
for the difference between regression lines at all values of the predict 
t()r VcVjable. As Figure 9 illustrates, Cronbach and Snow's confidence 
region will be narrowest at the mean of the aptitude variable and 
widen to thither side. Cronbach and Snow's technique is essentially a 
confidence interval technique for the differences between means. A 
direct statc^ment about the limits of the interaction effect is attainjed 
by setting confidence limits on the population differences corres- 
ponding to the differences in ()utcome that describe a sample interac- 
tion, Su'ch confidc^nce intervals put the differences between regres- 
sion slopes in propei- perspective in that they demonstrate the proba- . 
ble range ot real differences as is shown by the hyperbola in Figure 9. 



Th(* (•(juation tor [hv ( ontident c limits hyperbola is ^i\mnbv 



^6 




where \ is the ruiinber ot siibjcc Is in Ircaimenl A; \.,, th(» number 
ot subjcHls in Ir(Mim(»nl B: \, ihc^ aptilLide varial^le value*; X^^^^ and 
\ he aptitude miMMs tor the [wo treat m(»nts; S^^^^^ and "^^^^i^y the, 
aptilu(l<» varian((*s tor the two tr(Mlmfnls; / , . th(» tabled 7-value 
tor 2 and (It de^ree^ ot tr(»(»(lom and the / - a (ontidence level; S|;, 
ihe (nt(»rion residual mean s()Liare JiiKMn scjiiare tor the criterion 
(Uaiations Ironi the' irtvitment r(*f>ressj()n lin(»s, 4)()oI(hI ovej treat - 
menls'; and (ft. \he (l(^gr(»(^s ot treedom tor S^,. AV± 6 . a tunc tion ot 
X 'the aptitude vanahk»i. gives [he hyperl^ola that (les( nbe^ the ( onti- 
(leme limits. fh(* vaku^s ot AV des^jibi^ the observed interaction and 
lhese*^'akies ar(^ obtained i)v sui)tracling om* w'i't.l:^^n^i^atment 
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Cronbath and Snow rioter to this cakuladoM as,a smuillancous (on- 
tickHKO liniil in thai il is clctinin^ a ( onHclcnt inltTval lor ali values or 
X. This approat h is sominvhal moriM onscrvalivcMhan ibc sue c rssfvc 
(ontKli^ncc inliTva! noUxl bv Podhott - as (h(* lalU^r will IimcI to 

a lar^i»r.conlKliMKi» inU»rval and will ran oljI turlhcr toward both 
tromt^s ot thi' distribution than will Cronfiath and Snow's ()r(H<xlur(^ 
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CHAPTER IV 
ATILIN2 



Program Description • - j 

This program tests homogeneity of group regressions and defines 
regions of significance for the case in Which there are two treatnUent 
groups and tvyo continuous aptitudes or traits that are linearly related 
to a criterion. Program outputs (1) table of summary statistics^ — group 
sizes, meafns, standard deviations, coYrelations between aptitudes 
and criterion and the intercorrelation between aptitudes; (2) multiple 
regression equations (V-intercepts and regression coefficients) for 
each group; (3) points at which thj? line of nonsignificance intersects' 
the X (first aptitude) and Z (second aptitude) axes and Its slope; (4) F- 
^ value, degrees of freedom and probability for the homogeneity qf 
group regressions test for (a) both aptitudes simultaneously and 
(b) each aptitude separately; (5) F-value, defgrees of freedom and pro- 
bability for the test of common intercepts (analysis- of covariance); 
and (6) equation for the region(s) of significance. A flow chart for pro- 
gram ATILIN2 is presented in Figure 10. 



Program Input 

Card 1 alphanumeric title card Col 1-80 

Card 1 parameter card 
.\- . » 

Col 1-5 ^ N for Group 1 (maximum = 200) 
Col 6-10 N for Group 2 (maximum = 200) 
Cori2 missing data option 

0 = all data valid 

1 = blanks are invalid 

2 == blanks and zeroes are invalid 
CoJ 14 output opti2Q^ 

0 = plot 

Q 1 = filrh 

2 = printed output only 
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Col 16 option for table of predictor and cri- 

terion scores listed by subject within 
treatnnents. If this option is taken, 10* 
codes will be read according to format 
and will be printed out (AS^along with 
corresponding predictor and crit'erion 
\ scores for ^subjects in each tre^atijient 
group. Subjects with rhissing data will 
not be listed in this table. 
0 = no table 
_ 1 = list ID codes and scores (begin ^ 
format cards with A mode field) 
. Col 18 no. pf cards per subject in Croup 1 

Col 20 no. of cafds per s^ubject in Croup 2 

Col 25^34 alpha level for regi'ons of significance 

Card 3 form^for Group 1 CoTl-80 
^ followed by Croup 1 data 

Card 4 format for Croup 2 Col 1-80 ^ 
followed by Cjroup 2 data. 

V- ■ ^ ■ ' 

Cards blank (after last problem) * 

for multiple problems repeat cards 1-4, omitting data 

Data cards shbulti contain subject ID codes (if desired), the two ap- 
titude scores, and then the criterion score. If Col 1 6 on the parameter 
card is 0, then formare must specify three F-cnode fields — the first two 
for the two aptitudes^nd the third for the criterion, tf Col 16 on the 
parameter card is i, then formats must spepify aesj^al A-mode field. 
(AS or less) for the\ID code and then the thfee F-mode fields. 




Example Problem 

Data for this problem will be the first and second predictors (ap-^, 
titudes) and the criterion given as sample data in Chapter VII (p. 95) 
of this maruial. Program control cards fot this example problem are as 
follows. 52 
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1, Alphanumeric title card , ^ ' 
, ; * ^ Example f^obiem for ATIUN2 



2. Parameter card 



/ 



0005000050 0 0 0 11 - .05 



3. Format card for Group 1 



(4X; 3F2) 



4, Group 1 data 



3. ^ Format card for Group 2 



{4X, 3F2) 



6, Group 2 data 

* 

7. Biank card (after last problem) 



8. EOF 



/T 



6 
9 



Rfinted outpui for this example problem is given in Figure 11 and * 
plotted output is given in Figure 12. 




SIATI Mies 



MEAN » 
CRI TERION 
FKEDICTORtL 
PREDICTOR 2 

SIGHA 

CR I TER ION V. ■ ■ 
PREDICTOR L * . 
PREDICTOR 2 

CORRELATION 

PREDICTOR 1/CRlTERlON 

PREDICTOR 2/CRITERION 

PREDICTOR I WITH Z 



STATISTICS 
GnOUP L 



50.0000 
1,000 
S0.6ai3B 



20.17*2 
20.6107 
2B.5339 



.90<>t] 
-.•759 



GROUP 2 
50 



<*l.%000 
'■SA. 1000 
41.5000 



19.1812 
26.LS26 
L9.9BL2 . 



-.7900 
.6000 



THE REGKESSION EQUATION J=OR GROUP i IS Y » i«.62B1 ♦ .3271 X -.6317 2 

THE REGRESSION EQUATION FOR 'GROUP 2 IS Y = 72.14I4 ♦ -.5394 X ♦ .121.9 Z 



THE F-VALUE FOR THE TEST OF HOMOGENEITY OF GROUP REGRESS IONS I S 139.1161 WITH 2 AND *4 
DEGREES OF FREEDOM WHICH HAS A PROBAilLITY OF .0000 



fi^ur** It . PriQivd ouipin ior-AJlUKI yx<\mp\v pnMvm — summary 
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Methodological Notes 

ATIIIN2 



, / tiomo^cnvny of Croup Ro^rossions, Mu/f/p/e AptHudes | 

By extending the linear single-dplilude model used m ATIUIN1. 
ATIIIN2 simultaneously tests p^firs ot aptitudes and isolates specific 
aptitudes tor which there are unequal slopes. BorKhm972) and 
lohnson and Jackson (19S9) provide discussions of aptitude-treat- 
ment interac tions involving pairs of aptitudes, for more than one ap- 
titude, regression planes and hyperplanes (three or more aptitudes) 
are analogous to the regression lines of the single-aptitude case. For 
two groups and two aptitudes, the linear model may be extended to 
tit the following case in which two aptitudes are linearly related to a 
criterutn 





a[)titudr B 



ATILIN2 constructs a f^ir,rt\odpl oU^e iorm- 

where is Vhe regress i()n coefficient for the first group membership 
vector. X^^ (scored 1 if is in Group 1, scored 0 if not); b^, the regres- 
sion coefficient for the second grc^up membership vector, X^. (scored 
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1 if S. is in Croup 2, scored 0 if not); by the regression coefficient of 
the product (X^.) of , and the first aptitude vector; b^, the regres- 
sion coefficient of the product (X^.) of X^,. and the first aptitude vec- 
tor; b^ and b^, regression coefficients of the products (Z^ ., Z2,.) of X^ . 
andjf^,-, respectively, and the second aptitude vector. The residual 
sum of squares for this full model ilef) has N - 6 degrees of freedom 
or, for more than two treatment groups, N ~ 3k degrees of freedom 
whete k is the nutnber of treatment groups. 

Program ATILIN2 performs three significance tests relevant to 
homogeneity of group regressions. These three significance tests in- 
volve comparison of the fuU model (3] to three different restricted 
models. Each of these significance tests is discussed in turn. 

, Test 1— Simultaneous test 0/ slope differences on both aptitudes. 
To.test if there are parallel regression plane slopes (criterion regressed 
simultaneously on bo;h aptitude-s) for the two treatments, a restricted 
model is formed by setting b^ equal to and setting b^ equal to b^ 

"in the full model [3]. The resulting rpodel is: 



■i 



or, equrvalently, 

V-b^X^, + b2X2, + + V2/ + ^' 

where A^. is the vector.of scores for the first aptitude and /A^. is the 
vector of scores for the second aptitude; the residual sum of squares 
for this restricted model (Iff) has N-4df or, foumdre than two 
treatment groups, N-k-2df where k equals the number of treat- 
ment groups. The f-test,for differences in group regression plane 
slopes is constructed in the usual manner using the error sums of 
squares from the full [3] and restricted [4] models. 

Test 2— Test of ^ slope differences on Aptitude 1 with slope 
differences on Aptitude 2 covaried To test if there are regression 
slope differences with regard to Aptitude 1 over and above slope 
differences attributable to Aptitude 2, a restricted model is formed by 



setting equal to b^ in the full model [31. The resulting restricted 
" model is: 

y, = b^X^ . + b2X2._+ b3(X3. + X^.; + b^Z^. + b^Z^. + g. (51 
or, equivalently, 

•y, =^b^x^ . + b^x^,. + b^A^. + b^z^. ^b^z^. + g.. ' 

2 

The residual sum of squares for this restricted model (Sg- ) has * 
N-5df or, for more than two treatment groups, N - 2k - 1 df 
where k is the number of treatment groups. The f-test for Aptitude 1 
slope differences with Aptitude 2 slope differences cQvaried is con- 
structed In the usual manner using the error suncis of squares from the 
full I3l and restricted [5] models. 

7ese 3 — Tesr of slope differences on Aptitude 2 with slope 
differences on Aptitude 1 coyanecf. The restriction for this test Is 
b^ = b^ and the restricted model is; 

V, = ^7^7/ + ^2^2i + ^3hi + ^4^4i + ^5^^1i ^ hi^ ^ ^ 1^1 

or, equivalently, 

y. = b^x^ . + b^x^. + b3X3. + b^x^. + b^A^. + h. . 

The error sum of squares ilhf) has N -5 df for two treatmhm groups 
or N- 2k- 1 di for k treatment groups. The f-test for Aptitude 2 
slope differences over and above slope differences attributed to Ap- 
titude 1 is constructed with (3) as the full model and (6) as the, 
restricted model. 

fnterpretation of results — Aptitudes uncorrelated. When the two, 
aptitudes are not significantly correlated, the result of the three sig- 
riificance tests are easily interpreted. Given significant results from 
Test 1 (the simultaneous test), an aptitude-treatment interaction ex- 
ists. Tests 2 and 3 can then be examined to determine if the interac- 
tion involves Aptitude 1, Aptitude 2, or both. If T^t 2 is significant, 
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then Aptitude 1 is involved in the interaction and Consideration of 
Aptitude 1 is necessary to an adequate description of the obtained 
interaction. If Test 2 is nonsignificant, then Aptitude 1 is not involved 
in the interaction and need not be considered irf describing the in- 

4 

teraction. Parallel conclusions regarding Aptitude 2 can be arrived at 
on the basis of Test 3. 

Interpretation of results— Aptitudes correlated Consider the case in 
which the two aptitudes are significantly correlated. Significant, 
results from Test 1 again indicate the existence of an aptitude-treat- 
ment interaction. However, the confounding of the two aptitudes 
complicates interpretation of the results of Test 2 and Test 3. For cor- 
refated aptitudes, conclusions must be based upon simultaneous con- 
^ sideration of the results of Test 2 and Test 3. If both tests yield signifi- 
cance, then both aptitudes must be considered in order to ade- 
quately describe the obtained interaction. If Test 2 is significant and 
Test 3, nonsignificant, then Aptitude 1, considered by itself, allows 
ah adequate description of the interaction. In this latter case, con- 
sideration of Aptitude 2 would be redundant. If Test 2 is nonsignifi- 
.cant and Test 3, significant, then it is sufficient to consider a single 
aptitude, Aptitude 2. 

When aptitudes are correlated, it is quite possible for an interac- 
tion to e^js! (significant Test 1 results) but for bottrTest 2 and Test 3 
to yield nonsignificant-results. Such a case arises when the aptitude 
variance? involved in the interaction is variance held in common by 
the two confounded aptitudes and neither Aptitude 1 nor Aptitude 2 
is uniquely involved in the interaction. When neither Test 2 nor Test 
3 provides significance, then it iS sufficient to consider a single ap- 
titude, but .the choice of which aptitude to consider is arbitrary. 
When aptitudes are highly correlated there is little need to include 
both aptitudes in the analysis as the variarKe which is explained by 
one aptitude is also explained by the other. Therefore, aptitude pairs 
for which the above sequence of tests is most applicable are those in 
which the aptitudes are minimally related to each other and each is 
significantly related to^the criterion. 
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2. Test of Common Intvnvpts (Analysis of Covariance) 

To test the null hypothesis that two treatment groups are not signifi- 
cantly different when subjects score at the mean of both aptitudes, 
♦ATILIN2 constructs a full model of the form 

^• = ^^7/ + Vz/ + V7, + ^/2/ + ^/ 171 

where V. is the criterion; 6^, the regression coefficient for the first 
group membership vector (X^.); the regression coefficient for the* 
second group membership vector 1X2^); ^^3/ the regression coefficient 
for the first aptitude (A^ •); and b^, the regression coefficient for the 
^second aptitude (A21). The residual sum of squares for this full model 
(ie^) has N ^ 4 df or, for more than two treatment groups, N- 
2 df where /c equals the number of treatment groups. 

The test of iommon intercepts involves placing the restriction, 
b^= 62, on the full model. The resulting restricted model is 

Yj = a + h^A^. + b^A2i'^^i W 

where a is the regression constant, f ■ is the error vector, and the other 
terms are defined the same as in the case of the full model. The error 
sum of squares for the restricted model (If / ) has N - 3 df. The f-test 
for common intercepts is constructed in the usual manner using the 
error sums of squares from full [7] and restricted [8] models. 

3. Line of Non$ignificance • . 

The line of nonsignificance is the line of zero difference between the 
two group regression planes (criterion on both aptitudes) — i.e., it is 
the intersection of the two regression planes. The regression plane for 
Treatment 1 is given by - ^ 

Y= a^ -^b^^A^ b^^A^-^ . [9] 
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and that for Treatment 2 j«f gjven by 

. jn (91 and [10], V represents the criterion; and a2, the regression 
constants for the two treatments; 6^^ and 6^2' ^^e Aptitude 1 [A^ 
regression coefficients for the two treatments; 62^ and 622^ the Ap- 
titude 2SA2) regression coefficiejits for the two treatments. The 
values of the regression parameters in [9] and [10] can be estimated 
from the data and these estimates can then be used to write the 
equation for the line of nonsignificance. The equation for the line of 
nonsi'gnifjcance is given by * * 

<^ 

4. ^Regions of Significance 

When an aptlt(jde-treatment interaction exists, it is of special impor- 
tance to determine if there are significant group difference's within 
the range of observed aptitude vafues. A region of significance con- 
sists of a set of aptitude values for which predicted criterion perfor- 
mance is significantly different for the two treatments. In the two-ap- 
titude case, regions of significance are defined In the two-dimen- 
sional space created by Aptitude 1 and Aptitude 2. 

Consider a single point in the two-dimensional space for Aptitude 
1 and Aptitude 2. The^ predicted criterion difference (D) betvveen 
groups at that point is significant if 

D^>f«(P -h Q)S^^ / (Nj -h N2 - 6) 

where Fa is the f-ratio idf = 1 and -\- N^- 6) required for the a 
level of significance; (P-h Q) is a function of (a) the values of Ap- 
titude 1 and Aptitude 2 defining the point in question, (b) the num- 
ber of subjects in Treatment 1 (N^), (c) the number of subjects In 
Treatment 2 {N2), id) the means and variances of the two aptitude 



variables, (e) the correlation between the two aptitude variables and 
(f) the correlations of the criterion with each of the aptitude varia- 
bles; and is the error sum of squares for model l3]. The actual ex- 
pression for (P+ Q) can be found in Johnson and Jackson (1959, p. 
443). ' 

Bounding values for regions of significance are given by the follow- 
ing expression: 



(111 



.2 ,2 



Expression [11] is an equation of the second degree involving A^, A 2, 
^1^2' ^2 ^^^^^ where A^ is Aptitude 1 and is Aptitude 2. 

As in the single-aptitude case, one, two or no regions of significance 
may occur. When there are two regions of significance, [11] defines 
an hyperbofa. How regions of significance fall with regard to this hy- 
perbola can be seefi m the toliowing diagram. 
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The shaded portions of this diagram represent the fegions of signifi- 
cance. When there is a single region of significance, [11] defines an 
ellipse with the region of significance falling within that ellipse. 

In a previous discussion of regions of significance defined with 
regard to a siogle aptitude (pp.28-33), it was concluded that tijie 
single-region finding may be of little importance. In that discussion, it 
was pointed out that a single region occurred only when there was 
marginal evidence (homogeneity of group regressions test) for in- 
^teraction and perhaps only when the chance probability for the 
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homogeneity of regressions test exceeded the a-level chosert^o es- 
tablish regions of significance. It is suspected that the conditions re- 
quisite to fmding a single region with two aptitudes ar^ analogous. 
Thus, the single're^ion finding with regard to two aptitudes may be 
of little importance. 

Importance of the region of significance in the two-aptitude case. 
Regions of significance mathematically defined in a two-aptitude 
space can have little or no practical ifnportance. The importance of a 
region of significance in the two-aptitude case is (1) a positive func- 
tion of the proportion of total observations which fall within that 
region and t2) a negative function of the amount of overlapping bet- 
ween the treatments within that region. Both of these indices of im- 
portance have been discussed with regard to the single-aptitude case 
(pp, 33-38), Generalization of the first index (proportion of total ob- 
servations within the region) and the second index (overlap index) to 
the two-aptitude case is relatively easy. With two aptitudes, a Treat- 
ment 1 observation evidences overlap if that observation falls closer 
to the Treatment 2jegression plane than the Treatmerit 1 regression 
plane and vice versa for a treatment 2 observation. In other words, an 
observation is counted as overlapping^if it lies^n the "wrong" side of 
the midplane* between the group regression planes. The overlap in- 
dex is then the number of overlapping observations in a region 
divided by the total number of observations in that region, ^ 

•The midplane equation 1s ■ 

MpfW^.M2,.) = 
(7,y + b^^(A,y.-A,y,y)-hfa2^W2. -^2,^)+^ 

+ fc72<^7/ " ^72' ^22*^2/ ^ ^22^^^^ 

where Mpi(A^., is the midplane criterion score for Aptitude 1 
equatto A^. and Aptitude 2 eqyal to A^.; V7 and Y2 criterion 
means for the two treatments; the fa's are from [9] and [10]; A^^ and 
*A27 are the Treatment 1 means on Aptitude 1 and Aptitude 2; and 
^22 Treatment 2 meaps on Aptitudes 1 and 2, 
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CHAPTER V 
. AtlCURV^ 



Program Description 



This program tests homogeneity group regressions and defines 
regions of significance for the case m which there are two treatmeat 
groups and one continuous aptitude or trait that is curvilinearly rel- 
ated to a criterion. Program outputs (1) table of summary statistics— 
group sizes, means, standard deviations and -correlations (Pearson 
product-moment) between aptitude and criterion; (2) regression 
equations (Y-intercepts and regression coefficients) for each group; 
(3) probability that the relationship between the aptitude and cri- 
terion is curvilinear for each group; (4) F-value; degrees of freedom 
and probability for the homogeneity of curvilinear regressions test;^ 
(5)>;^alu^,9<f?g^>es of freeclQm and probability for the test of com- 
mon infim^epts/for curvilinear data (analysis of covariance); (6) ap- 
titude value(s) at which the curvilinear regressions intersect; and (7) 
aptitude values which define the region(s) in which treatment groups 
are significantly different (regions' of significance). Figure 13 presents 
the flow chart for program ATICURV. 




Program input 

Card 1 alphariume^ric title ^tffJCol 1 80 

Card 2 parameter card 

Col 1-5 N for Group 1 (maximucn = 200) 
Col 6-10 N for Group 2 (maximum = 200) 
•Col '12 ^ missing ciata option 

0 = all data valid 

- ' ' 1 = blanks are invaKd 

2 = blanks and zeroes are invalid 
Col 14 . output option 
• a= plot 

1 = film 

• 2 = printed output only 
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Clt4rt ^ 
ATICCTt* j 




\arctai th»»»nV 


Call 
•uhrauttn* 

AMISMr' 








SUMUTA 













1 ATiCURV J 



anri irayh 
far yUttar 



Vlat riatf. 
rairaaatao Una* 
ra|ta»<i) ■( 

•t(»lf Icanca 
(ir daftnakla) 



Sufc rai. 



Ilnaa 



Ctif; RaB4* C*ncr»> cmiin ani daci 
AHMOATt Dalataa tnval U and/ar ■iaaliR 'aC« 
SVNDATAi CanfuCai nan* %ai mmimtt ^aviaclaoi 
ZPOLni Calculataa a'luwnta a( rfaCarntnaaca 

far raRlana af «l|nirtc«nca 
AHtttWIt Dacanilnea BtntauB ni tuilaua taluaa 



VAMI; 



•f a 

Caapuiaa fvlRta af • 



■aurai 



Figure 1 \. flow chart lor program ATICURV. 



ERIC 



61 



68 



Col H) o^Xion tor tabl,e ot prt'dictor and cri- 

• lonon scores listt'd by sub)oct within 
, , ' irealmcnts. It this option is taken, ID 

C(^dt»s will be read according to tUrmat 
^ and will bo pr-inted out (AsTalong with 

corresponding predictor criterion 
- scores -^or subjects in each treatment 

* * grourp. Subjects with missmg^dala wH[ 
. not be libted in this table. 

" ^ 0 = no table 

1 = listID c^)^s and sccj^es 
/ . ^ (begin format with A n]ode fi(t»ld) . 

. Col IB no, jof cards per subjec t in <jroup 1 . 

Col 20, ' no. ot cards per sub)ect jn Group 2 
Col 2S- M alj^ha level used to test whethtM' tl linear 
Or c urvilinear rtiodel is appropriate" 
, C^}\ 'i^}'44 ' alpha level used to deterrhine regions of 
, signifi(,anc-e ' 

' Card i format for Croup I Col 1-80 
followed by Group 1 data 

Card format for Group 2 Col 1-80\- / ' • 

f()ll(>W(*cLby Group 2 data 

" Card S blank (after last problem) , 

^ for multiple problems repeat cards l-^* eimitling data 

Data cards should contain subject ID cod^s (if desired^, the xip-^ 
lilude score, and then the c r|terion. score. If Col 16 on the parameter 
card isO, thc»n fottnatsjTiust specify twof-mode fields — the first field 
for the altitude and the second for the criterion. If Col 16 on the 
' parameter card is 1, then formats mdst specify cjn initl<?l A-mode field 
(AS or less) .for xHv ID code and then the fwx)" ^-rriode fields. 



Exampje Problem ■ ^ , ^ ^ ^ • » ^ . 

Data for this problem will be the first predictor and t'he criterion given 
as sample data in Chapter VII (p. 9S) of this manual. Program control 
cards for this example problem areas follows: , ^ 

<» - • , . , . V 



: 6 9 ^ 



1. Alphanumeric title )Lard ^ 



Uample problem tor ATICURV 



2. Parameter card 



^ ^ 0005000050 0 O 0 11 .05 .05 
1. Format, c ard ((ir Group 1 



"/ 

4. Group, 1 data 



(4X, F2: 2.x, F2) 



5. Format card for Group 2 



F2 



, 2\, F2) 



6. Group 2 data 



7. Blank card (after last problern) 



8. EOF 



8 

9 * . ^ 

Printed output for this example problem is given in Figure 14 and 
Q "plotted output is given in Figure 15. 
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t.^ .•66* MifH ; AND ^6 Dt&WtS OP FRjfDOM wnrCH HAS A PP.01 A* 1 1 [ T Y OF . 4 1! 

A RFGrON OF W.'.NIFKAN(t MTEr*D^ mOM g. 9(1(1 rn qi ^^4. 
HHfUf ^ a.0ll(M IS THf «INtMU« DDStRVfD Ap T I T UDE V Al Uf 

A Mf^flN f)F SI ,NlFI*ANff MTlND-; FROM fc9.^^(| TO oft 0)93 

«H6R6 9(1.9989 >^ ThE HAX|Mu« HDSfRVED A"[fuDE VALUF 

> 6N0 OF JOB. *• «. 



FiKurr 14^ rrmtcdoutfHil lurAJK (JRV cxjmpir fnohlrm—summJcy 
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Methodological Notes 



AFKliKV 

/ fv\t /or ( unthniwr Ojtii 

A giMK'Ml distussion or the i]f)f)lu ahon ot regression cinalysis rmMhods 
to nonlinear relalionshif)s tan bv tound in. Kelly. B(^gs, NU Neil, 
f u helU^r^er. and I yon < 1 W)> Fcr'lesi the hypolhesjs ihal the vvithm- 
grouf) relationshif) l)etwtvn an af)tHu(je and a criterion is (urvilinear. 
the standard turvilinear ((|uadratK) prediction model is\ onsiruc ted; 

V - a ■♦- h^X^ -I- b^X^^ ■♦- c 

where Vis the t riterion. a, the regression constant <inter( ef)t|: by the 
regression (oettK lent tor the (irouf) t a()titude vet lor. X^. and b ^ the 
regression ((u^ttuienl tor the vector {\y tom()osed ot the s(|uares ot 
the (jouf) 1 af)titude scores Thi' fesicJual sum ot scjuares (^e*-^ lor 
this model has d(»gr(»es ot treedom ecjual to the number ot subjects 
nij^s th(» nurTil)er ot ind(»f)en(Jent ()aramelers — S ^ ^ i, where is 
the number ot subjects in (irouf) 1 

'The test tor c uTvihnearity involves comf)arison ot the f)redic tive 
etticiency ot model U2\. the curvilinear mod(»l, with a simf)je linear 
model The af)|)ro|)ria(e simf)le linear rtiodel is 

Y^d + b^X^ -f /. M\\ 

The error sum ot scjuares (i./-) tor model 11 \\ has d(»grees ot treedom 
e(|ual to \^ ' 2 The ^test tor c urvilmearity is constructed in the 
usual' manner using the c^rror sums of squares from the full model 1.12) 
and restru ted model It 5) A stgnificant T-ratio iridic ales a significant 
Q linear rc^grcvssion ot the criterion \)n the aptitude. 



{ R\ rrpr.Ks ihis trst ( )t i urMliiuMritv tor Irr.itiiH'fit 2 and re- 
ports thr results ot tfu' trsts tor l)ot[i tre.atnrnts \otr tfiat tfie of)era- 
tion ot this program is unintlucrK i)v tfir results ot the tests ol ( ur- 
xilmearitv Ihus AIUrKV pro(ee<ls witfi sul)stu|uent si^nitiiarKe 
testing ihonu)i;eneit.\ ot re^r(»ssions, an.ilvsis ot covanance. and 
regions ot sii;nituante as thoui;fi l)otfi witfiin-tre.itnient le^ressions 
are t urMline.ir regardless ot wfietfier tfie test ol ( urvilmearit v is sig- 
nitiianl tor l)ot[i treatments. onl\ one treatment, or lUMlher ot the 
treatments [ se ot \ll( is not r(»( ommended to the researcher 
knows l)elorefiand tfiat fie is dealing witfi Iiiknu rath(»r ifian ( ur- 
\ilinear data Instead pro^r.un AlllIM sfiould l)e used in this t ase. 
\ppli( .»lM)n ot -MK I KV'^o //n(\H dat.j ( ,in result in a possil)le Iov^^ 
st.ilistu .il powei due to tfie loss ot decrees ol lr(»edom in( urred In' in- 
( hiding ( uf\ ilineai \.uial)les s(|u.\red tt^rnis' in tfie regression models. 




iotes! the fnpotfiesis tfhil tfie re'i;r(«ssions mik ludm^ c urvilinear ( om- 
ponents lor tfie l\\o tie.ilinents are£).irall(i .th(» lollouin^ tull model 
IS ( onstrui led 

' . 1141 



uh(>re IS tfie tirsi i;roup memfiership V(>t t(jr stored I it Sul)^*^ t / fs 
in (.roup 1 and s(or(M| 0 otfieruise; \^,^ ifie se( .md ^rdup-mt^mber- 
slnpxedor stored i it Sul>|e('t / is in ( .roup 2 and st or(»(l 0 oth(»r- 
wise \hv produ( t ot and tfie aptitude vtntor, and tfie 

produ( t .)t \ and tfie aptitude vet tt>r. I fie /)'s in 114| are 
( .)etti. lents .md e^ ri^pre'^tuit s tfie Vrror v(>t tor Iht* error sum ol 
stfuares tor tfiis tull model lias \ h ii\ or, tor more than two treat- 
ment groups. \ \k (It whvrv \ is tfie total numf)erV)l sul)jects ^ndk 
is tfie nuiiiber ot treatment groups 

Jo test It tfie ^roup regressions are homo^cMieous (parallel*, the 
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roslridions 6^ and h,^ h^^ ,uv pUnvd on the full hmM. Th( 
resulting r(»slri(t(»d m<)(J(»l is 



or, ('quiv.il i^n!|Y _ 

wh(»r(» IS ihr v(»(l()r ot tif)|itu(J(» scores and \^ ihv v(»clorol ih(» 
squares ()t th(» a()lilud(» scorers [he error sum of s(|udr(»s Ht f) lorMhis 
r(»stn(1ed modc^l has N 4 dt «r, tor mor(> thar\ two lr(Mlm(»nl groups, 
N k 2 dt whvTv A is4h(» njh^:)(»r ot tr(Mtm(»nl groups 

rh(» /-ratio tor homogc^ntMly ot curvilincMr grouf) regr(»ssions Is con- 
■ slru( l(»d tn ihv us\ial mannc^r using [hv error sums ot s(|uar(»s trom ihv 
Kill 114) and rc^stricted I rsl^models. A significant /-ratio indicates that 
th(» (urvilmcMr rc^grc^ssions dittcT tor the* two trcMtmc^nt groups and 
thus that an ai^itude-trcMtment int(»ractton c^xists, . 



i fes/s ot (c ommon Intcn rpts (Curvilinv.n Analysis of Covanam c^J 

To lest th(» hypothesis that two treatmc^nt groups are' significantly 
(iitt(T(»nt wh(»n subjects scorc^it the mean of an aptitude which iscur- 
vilinearly reflated to the critc^non, mode*! (IS) is employcnJ as th(» full 
model Jhv rc^stnction bj is placed on |r>K rc^sulting in the 

following restrutefl model: 

' ^=^^^^A^'vf^«, (i(>i 

where a is the rc^gression constant {y-intercef)t}; is ihv rc^sidual ct- 
ror; and the other tc^ms ar<% as d(>fin(^d for |15|, The error sum of 
squares Hg"^) for this rc^stru ivd m7)d(»l has N ~ J df The T-tc^st for sig- 
nificant V-mterccpt difference's for the* two trc^atments is constructed 



in ihv usual nfnnii(»r usin^ \Uv terror sums ot s(|uares trom the full [ISl 
and restrict(»(i |H>1 models A si^nit.icant /-ratio mdicatrs that the V- 
int(»r(epts ditt(^r tor the; two tr(Mtm(»nts. Given that the y-int(»r( cpt for 
one lr(Mlmvnt is si^nitu antly ^rcMtcr than that ot the other and ^iven 
that'^rouf) r(»^ressions art* homo^en(»ous, it (an be concluded that 
the treatment witK the hij^her interc ef)t demonstrates overall c rilenon 
suf)erK)nty within the rrtn^e ot thc^ observed data. 

4 Pom/s ot Intvrsri Of>n 

When ^N)Uf) re^rvssions are ( urvilinear,lhere may be one, two, or no 
points at whith the regressions tor the two j^roups intersect. These 
♦ ditter(»nl o('curr(»nces are shown in figure 16, 

Mathematically, thc^ [)oint(s) ot intersection are determinc^d from 
the within-tnfMtnu^nt re^r(»ssion ecjuations. The regression equation 
tor TrcMtment 1 is 

+f>-,,A + b^jA^ jl7| 

where is the [)redic ted c nterion score; a^ the re^n^ssion constant; 
h J ^,.the regression (oetticient tor the aptitVjde variable (A); and h^^, 
the regression ( oe\ttic lent for the scjuare ot the af)titude vanable. The 
analogous re^r('ssi()rT^e<fiJatioVi tor Treatment 2 is 

U^r^'l/'* \ 1181 



A point ot intersection olcu'rs wK(*n ^'^ = Oo\, equt^s^ently, 
when , ^ * 





•i|)titu(jt> 




Figure^ If).. Points of mtrrsr( Hon for thrvv hy^pcHhcticai cases. Curved 
imvs roprcscnt ihv regressions tor two treatment groups. 
Case (a) involves no point of intersection; ca^e (b), one 
point of inteisvc tion; and case (c), two points ot intersec- 
tion 
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Solving M^Mor A yields aptitucU' vdlut's corresponding to the points 
of inlersettion. Expression, M^)| is a (|uadratK ecjiiation and af)plVing 
the well-known solution ior suc'h an ecjuation [)rodu(es 



A = 



r/ ^ — ^ ^ i 

..If Ihrlerm under th(^ fadical in |2()| is negaliv(\ then there are no real 
.solutions to liOl and there are no points ot interstH tion, H the term 
under the radical is 0, th(»n providey^ingle solujion and the* 
single point ot int(»rse( tion occurs at the corresponding aptitude 
value II the term under thc^ radical is posUive, thcMi 'there are two 
solutions to 120) corresponding to the tvvo aptitude values at which 
intersec ti( )ns oc c ur ^ 

'> Ke^/om of S/^^7;f;( am e 

lohnson ancJ Nc^vmari < I4U>>. while interestc^d in problems involving 
lincMr reki1ionshif)s, em[)loyed a statistical paradigm which does not 
restrict thc^ rc^lationship hetwcH^n a criterion and aptitude* variable* to 
one* ot line.^itv VVunderlich and Boric h <I474) have* extendcul the 
regions ot signilK anc e [)roc culure originally suggested by lohnson and 
N<>yman to problems involving a c|uadratic rc^lationship betwc^en cri- 
t(*rion and a[)titude. Ciiven an aptitude-treatmc^nt interac lion and c ur- 
vilinear cjuadratrc) regressions within treatments, it is ol f)rimary in- 
V terest lo determine* it the* xlitterenc e b*twe^'n pre*dic t(*d crite*rion 
s(()r(s— le, the distance be*twe*e*n the* regression curves — is signifi- 
cant tor. any aptitudes vatue*s within the* range ot c>bserve*(l aptitude 
se ores A region ot signiticanc e* c onsists ot a s(*t ot a[)titude values for 
whie h predie led c rilerion [)e*rtormanc e* is signiticanlly different tor the 
two t real me ^n Is. ^ ' , 

Consider a single aptitude value*. The* preclic tc*d c rilerion ditferenc e* 
'/;> betvueen treatments at that value* is sifjniticant it 
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> fafP + Q)S^ ^ (N^ -\- N^- 6)- 12 1 



whore fa is ihv F-UWo idf / and -f - 6) required tor ihe a 
level of signiticance; -♦- Q) is a tunclion ot (a) ihe aptitude value in 
question, [b) the number of subjec ts in Treatment 1 (N^), (c) the num- 
ber of subjects in Treatment 2 (N^), (d) the mean and variance for the 
:. aptitude variable and the square of the aptitude value, (e) the correla- 
tion between the aptitucJe variabt and the square of the aptitude 
variable, and (f) the correlations of the criterion with the aptitude 
variable and with the square of the aptitude variable; and S'^^ is the er- 
r(ir sum of sqpares from model ! 1 4|. The ac tual expression for (P -I- Q) 
for the two-aptitude (asecan be found in Johnson and Jackson (1959, 
p. 44 5). If the square of the aptitude is treated as a second aptitude 
variable, then this expression is appropriate to the single-aptitude, 
curvilinear case. ' ^ 

Bounding values tor rc^gions of significance are given by the follow- 
ing expression: 

r2 



^ — = 0 . 

^7 -^'^2~^ '^^ 



Expression [22| is a fourth-order (quartic) equation involving the ap- 
titude" variable. ATICURV solves this quartic equation by first finding 
a solution for a rt^solvent cubic equation and then using this 'solution 
to obtain all four roots^of the original quartic equation. Expression 
1221 yields two, four, or no rcMl solutions corresponding to bounding 
Vfllues, . ' " ^ 

After calculating bounding values, program ATICURV determines 
the locations of regions of significance with regard to these bounding 
values. A-boundmg value is an aptitude score with a region of signifi- 
cance occurring on 'one side (abo.ve or below) of that score and a 
region of nonsignificance occurring on the other sucle of that score. 

Consider the following example in which tvyo»bc)S^ing values (A 
i^'^ B)'have been obtained. 
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In this (»xamj)l(\ (Mth(»r <a> Rc^^ion 2 may invwlv(» si^niticarK (» while 
Regions l-and \ involve nonsi^nilu anc (» or (hJ K(»^ion I may involve* 
nonsi^nitK an( (' with Regions 1 tyi(l i involving si^nilKan((\ It [hv 
vvilhin treatment regressions inters(»(t, th(»n it is (»asy to d(»t(Tmine 
- vvhi(h (ase — 'a) or tb) — is true. A region containing an int(*rs(»( tion 
<[)()int ot zero dilterence between the ri^gression lin(»s) is always a 
r(»^^ion ot no.nsi^niticance. It Region I or Region i contains an intcT- 
. s(Htion, then case (a) is true. On the oth(»r hand, it R(»^u)n"2 contains 
an inlers(»( tion, then Ccfse (b) is true. , 

locating rc»g!()ns ot significance tor curvilinear regrc^ssions, 
howc»vc»r IS not always as simple* as shown abovc\ As demonstratc^d 
in. figure* \7, two n{)n|)arallc*l curvilinc*ar regrc*ssiuns ncu'cl^not Inter- 
svc I C ()nsidc*r situation (a) inligur<» 17. Tw^) bounding valuers (A and 
exist in this situation. Does the region between A and B involve 
signitic anc e or nonsignitic aHc c»^ One* might guevss that the region bet- 
vv(»e»n A and B is a region of nonsignific ance*, since* the* minimal dis- 
tance* betwe*e*n group regre*ssi(>ns falls in this rt*giocLJdowe*ver, suc h a 
gue*ss m.iy prove* false. The* distance*s bet wee<^ rogre*ssions within a 
regionot significance* may actually be^ smalle*r than the distances 
within a bordering re^gron of-'nonsignific anc e* — such is the case* when 
a single* re*gion ot significhnee is found in the onc*-pre*dict-or, lincMr- 
re*gre*ssions case (ATILINI) or whc*n an elliptical region is found in the 
two-f)re*dic tor,Jine*ar-re*gre*ssi()ns case* (ATILIN2). Without furthe*r in- 
formation, it IS impossible to dele*rmine if the* re^gion be*tween A and B 
IS on(* ot signilie ane e* or nonsignific anc e*. ^ , 

.Situation (b) in hgurc* 17 also f)re*se*nts a problem, i^o bounding 
value»s are* obtaint*d, so there is only one re*gic)n. hH()we*ver, doe*s that 
re*gion involve* signifu ane e\or nonsigniflcance*^ Without additional in- 
Q formation it is impossible to te*ll. Program ATICURV de^ls with such 
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Group 1 




aptitude 



Croup 1 




Ciroup 2 



aptitude 



re 1 7. Two examples of nonparallcl and noniniersecting regres- ^ 
sions. In silualion (a), points A and B represent bounding 
values for regions of significance, Witliout additional in- 
formation, it is impossible to determine where signifi- 
cance lies with respect to A and B. In situation ib), no 
bounding values are obtained. Without additional infor- 
mation, it is impo^^ible to determine if Croup 1 is signiCi- 
- cantly superior for all aptitude value^ or if there 1s no^lg- 
. nificant difference for any aptitude value. 
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[Kobloms in the tollowing m.inner. Tho midpoint of each region falk 
ing within the -observed aptitude values is calculated. The signifi- 
t ance ot the ditterence (distance) between regressions is evaluate'd at 

.'each midpoint (it expression 1211 is true for a midpoint, then the 
difference is significant at <hat point). A significfiant difference at , a 
midp()int"indi( ates that theVorresponding region is a region of'signifi- 

, cance, while a nonsignificant difference at, a midpoint indicates a 
region ot nonsigniticance. F^rogram ATICURV reports the upper and 
lower bounds for each region of significance falling within the range 
of observed a[)titude values. „ 
^ Importam c ot ihv region of significance tor curvilinear jygrvssions. 
Recall (onsid(»rati()ns previously made with regard to the importance 
ot a region ot signifit afR^e tp. 33). Such c onsiderations also apply to 
rc^gions ot sig^nitic ance definc^d with regard to curvilinear regressions, 
within trcMlments The importance of>a region of significance is (1) a 
[)ositive function of the^ f)r()portion of t^)tal c^bservations that fall 
within that region and 12) a negai^ve tunc t ion of the amount of over- 
lapping between the trc*atments within that region. Recall that a 
TrcMtment I observation evidence's overlap if it falls closer to the 
TrcMtm(»nt 2 regression line than the Treatment 1 regression line. In 
other words, an observation is counted as overlapping if it falls on the 
"vvr(')ng" side of the midline between the group regression lines, the. 
midline belwc^en curvilinear (quadratic) regression Jines is given^by 
the following ecjuation:, i . 

where MptiA^ is the midline criterion score for the aptitude variable 
c»(|ual to A.; <wdYy are the c riterion means for the two treatments; 

and /T, are the aptitude means for the two treatments; and the b's 
are from [171 and 
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X'f -Proigraifi S),escrip^ion \ / *'^| 1^- 

Thj^,p[)(%rarTv:per|5rm$ a^freatr^nt'b^%locks analysis of vaciapce for ' 
tWp-fireatnie^tgra^ 

ea^wBStrnfent, ii jgh- "arid Jpw-aptilud^ dwigorigs. are formeJl: by ' 
selecting, extreme cases, The.percenJLage of ^^s in the^^ . 
^ in* the.-exf reme aptitcP^e categories ^ (and^ thpMo'fe' InGludjed iri the ^ 
ffej^tnieftt-by-blo(^s analysis ^f yaf^nce) i$ fre)^^^ yaryjf 1 0?5> Qt tthe , 
S"^ are;to be iriqluded^ theri :th6: 1O*!^ 0f th^^^ Ss wiJth^^e . 

hTghest^|0|tud^^^^ . ♦ , 

4|)d the iS^^f the Jreatfn^^ the Jo west aptitude scores 

area$signe^«th^lov^^^ 10% 
' oftrttgljeautfent.2 ^ 

, ' ,Pro^^»^XCf^Uf'S ferfprnhs rpulttpte tFeatment-|>y-block5 analyses 
• ^s^&$^tx^pf:>^lTi% to a diffe/ent percentage of the sample tplfc»e m- 
^^lu^8^in tlW^Xtj[en3e grob^^ o 
.l;ion;aUb^s4heii$erJto input the^xac| percentagpljto be includedfin 
,1,, ^ the extreme g^vps (ajiiaximum of siXiperceritages is ^llovyed), and a 
^Vsepan^te treatm§nt-by;blocks^aoalysi i^.f^ien computed for e^fh per- , ^^^^ 

eerifage. If the sec^<^.d:opti^ is selected then extreme groups, with 
. 1 0, 2q; fQ^i^d 40'Pefcent pf thcj sample are const/uGted:Spd the- cpr^ > ^ 
^ respdnding^four analyses ar^^perfocmed. Statistical pqj^^Vr / . 

cakuj^^ fpi^^iairi-ai^^^ effects iri each aoaiy$js ^pw ing'^ / - 

' fhe^lrfodeterrnihe4»^ 

.^^\statisfeaLj^ outputs sqmS/of ^ic^areS/ ,degreest:^ 

^ , f^e'dortt^;.nieari squares, f-yalu^, pro^abill ties,^ povyet.Wtirt^^ antf 
ceii/rneans for^treatmet^tiraptftu^e level (hjgh ys/loSy>; anj^: — ' 
^ : ' *;nf^rt^ by/fevefs/A fjovy r^^^^^ XCf^pUPS i$ pre^iW-'* 



77 -c r-\ 




• ; . XGROUPS 

Program Description . . 

, V r ' . " . f > 

/ ^ tlh\^ [)r()gram f)ert()rms a tr€Mtw*nt-by-bl()( ks analysis of variance for 
two triMtme'nt ^rt)uf)s dndjwii\v\/iAs of the aptitude variable. Within 
each treatmtjnt, high- and lo^rti-aptitude tategories are formtrd by ^ 
seJec ting extreme cases. The peRentageof 5s in the sample inc,luded 
m the extreme* aptitude* c at egories (and, therefore, included in the ^ 
freMtment-by-blotks analysis of var)ancO) is free to vary. If 10% of the 
are to^be tnc [ude*d, tk^n the 10% of the Treatment 1 Ss with the 
highest aptitude- scorers are assigne*d to ihe high-aptitude category 
^ and the 10% of the Treatn^ent 1 .Ss with thc^ lowest aptitude scores* 

are* assigned U> the fow-aptitude catc*gory. In analogous fashion, 10% 
of the TreMtment 2 Ss are assignc^d to each of the aptitude categories. ^ 
Program. XCROUPS perforins multiple "treatment-by-blocks analyses 
each corresponding to a diffc^rertt percentage of the sample to be in- 
c luded m the extreme group. Tvyo options are available. The first op- 
tioa allows the usW to input the exact pe*rcentages to be included in 
1 the e»xtri»me groups (a maximum of six pt*rcentages is allowe^dl, and a 
. se»fwate» tre»atment-by>blcK ks analysis i-s then computc*d for each per- 
tentagev If the seccwid option is selected, then extreme groups with 
10, 20, iO and 40 percent of the sample are constructed and the cor- 
r(»sponding four analyses aro'performed. Stat^istical power (7 - /3) is 
calculated for^jmain and interaction effects In oach analysis, allowing' - ' 
the user to ciotermine the (>xtreme group size resulting in the greatest 
statistical ^pc)we»r^' Program outputs sums of squares, degrees^ of 
free»dom, mtMn squarc»s-, f-value^ probabilities, power estimates and ' 
cell mcMns for treatments, aptitude level (high vs. low), and treat- 
ment^ by levels. A "flowVhart for program XCI?OUPS is pre?l^nt^d in ^ 

. ' Q Fig(ire18: : / ^ . . ^ ' 
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^ioijre 18. F/ow chart /or program XCROUPS, 
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Program Input 

C arc) X at|)hanum(»rK titli» card Col ^^i^^,, * .^^ • 

( jrd 2 f)drimu'li'r cud 

Col I S \ lor Crouf) I 'maxunurTi - 2()()> 

( ol \ tor Croup 2 miaximum - 2(H)i 

C ()| i2 missmg data o[)tion 

' • » 0 ^ all (lata valid * . 

V 

1 blanks arc invalid 
•* 2 - blanks and /crocs arc invalid 

( Ol 14 [)crccr|l (xt sam[)lc o[)ti()n ^ 

* . A zero m this (olumn IS a default value; 

the projpam wifi fU'rtorm analyses with 
U), 20. M) and 40 percent ot the samf)le 
in eac h ot the extreme grou[)s An alter- 
native sbt ol percentages can be re- 
Cjuested by indicating, the number of 
percentages desired (maximum = <;>) arid 
then m( fudmg the alternative pmen- 
tages on ( arc! Hsce below) r • - 
col 1(> ()[^tu)n lor table ol predictor and c ri- 

' t(»rion scores listed by subjec t -within 
treatments It this ofMion is taken, ID 
codes will be readr^ac cording to format 
and will be printed out (AS) along with 
( ()rrespt)oding predictor and criterion 
scores tor subjects in each' treatment 
group Sobjects with misSing data will 
' not be Ijsted in this table. 

- 0 = no table 

1^ = lisf ID codes and scores 
• , (b(*gm tormat cards with A mode 

tietdj ^ ^ 
Col"18 ' no, ol cards per subject in Group 1 

• Col 20 no, ol cards per sul^ect in Group 2 

* ■ 

Card \ * (optional — include only it Col 14 is not ()) indicate in- 
teger percent levels dc»sir(»d in Col 1-3, 4-6, 7-9, etc., as 
' n(»(essary (maximum = 6) 
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' ^XiUii 4 tornui tor (jouf) I C ol I HO 

l()ll^wr<f [)v (.fouf) 1 (1*11*1 

/ 

( o/d t()rm«u tor Cirouf) 2 C ol l-8() 

tollowcd by (jrouf) 2 ()*U*i 

C arc) () bl*ink (*itl(»r l«isi f)f()blcm) 

tor mUl)fTf)lo f)r()bloms ro\n\\[ tards I ''). omilling data 

Data cards *»hould contain subject til codes tit.cJcsfrcKi). the ap- 
mucJc score* and then the* criterion score It C ol 16 on the [)ar*im(n(v 
card isO, then tormats must sfXH ity two F-modeMjelds — the first field 
for the aptttucJe and the second lor the criterion. If C<itUl6 on the 
f)aramel(»r card is I , jhen .formats must spec ity an initial A-mode field 
'AS or lei>s) tor the l[) cocJe and th(»n the two F-m^cie fields. 



Example Problem 



[)ala for ihs [KoWem will be the first [fredictor anc( c riterion given as 
sample (lata in Chaf)t'er VII of this manUal. Program control 

cards tor this exam[)le problem, are as follows. 



1 Alphanumeric title card 



rxamf)le f)robler1i (or XCROtfjPS 



2 Parameter card 



/ 



0005000050 0 0 0 1 1 



5 C utoff percentage* card 'optionah 
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4 Formal ( aal tor ( »r()Uf) 1 



/ 

^ ' (jfouf) 1 (lata 



4X, F2i 



h Formal* ( arc! lor (jroup 2 



(4X. 12. 2X. F2h 



(jfouf) 2 (iala 



8. Blank card MtU*r lasl probU^m) 



9 K)F 



7 
8 
9^ 



FVmU'd oulfHit tor ihis oxampU' problem is give*n in Figure 19. 
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gXTREME GROUPS ANALVSISi LEVEL I 

NO. OF SUBJECTS IN TREATMENT 1^ ■ 
NO. OP SUBJECTS IN tREATMENT 2 ■ 

REQUESTED CUTOFF PER£ENTa|cE ■ \% 
ACTUAL XUTOFF PERCENTAGES^j 
TREATMENT I >lB.Bn« 
TREATMENT / 'ILBMB 



FXTNCME GftOUP SIZESt 

NO. OF SUBJECTS IN EACH TREATMENT I GROUP 
NO. OF SUBJECTS IN^ACH TNEATMENT 1 GROUP 



SOURCE 

GROUP(G> 

TREATMENJI T) 

GXT 

ERROR 

TOtAL 



SS 
125. ■«> 



DF 

k.M 
l.H 
1.00 
16.91 
19. ■■ 



MS 
12). 10 

1.8a. 10 

17495.01 , 
65. Id 



1.9231 
2.76*2 
26 7. 76<)2 



.I61i96> 
.112175 



fOMER 

.2*5526 

.36aait 
i.Hiiii 



TREATMENT MEANSt 
< TREATMENT I > 48. 110 

TREATMENT 2 • «2.iii 

GROUP MEANSt 

HIGH > 1^7.510 t 
LOW • «2.5ii. 

GROUP BV TREATMENT MEANSi 

TREATMENT 1 HI • ti.iiB 
TREATMENT 1 LO > U.dia 
TREATMENT 2 HI > ^5.a00 
TREATMENT 2 LO > 69.000 
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Figure I*) ' rriplrd OQtfwt tor pr()p>rjm XCROUPS cxdmplo 
f)r()bhnr ^ 
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ElTKEME OHUUPS ANALYSIS) LEvU 2 



NO. Of subjects lU TKEATMENT 
NO. OF SUIJECTS IN THE*TNENT 



HEOUCSTED CUTOFF •PCHCENTAGE 
ACTUAL CUTOFF PERCENTAGES 

TREATMENT 1 •^%^%%t% 

TREATMENT I -^i.iiii 

EXTREME &ROUP SUESr 

NO. OF SUIJECTS IN EAC.M TREATMENT 1 GROUP 
NO. OF SUIJECTS JN EACH TREATMENT 2 GROUP 



SOURCE ~ 

GR0U1*CG> 

TREAtMENT ( T ) 

GXT 

ERROR 

TOTAL 



SS 

^i.ii 

160. ai 



DF 

i.ii 

i.id 

14.ll/ 

39. ■0/ 



MS 

* Qi.ti 

22562.91 
12 3.19 



.7316 

1.298i 
183.1<iS<i 



.«ff2t26 

.261021 

.■■■ill 



POMER 
.131991 
.21^129 
1. ■■■■•■ 



TReI^MENT MEANSi\ 

TREATMENT ly '.9.75^ 
TREATMENT 2 V '.i.TS^ 

GROUP MEAfl^i 1 

MtGM • <>1.IS^ 
LOW - Ub.lAt 

GROUP It TREATMENt\eaNSi * 
TREATMENT 1 MI^- 
TREATMENT 1 LO " 2*.5«a 
TREATMENT 2 H) - 23. ^■^ 
TREATMENT 2 LO - 68.^^^ 



figure IV u onlinubcl', Pnnlrd output tx)f program XCROUPS vxcim- 
plv pmblom.^ 





EITrUe GROUPS' analysis I level 3 

NO. OF SUiJCCTS IN Tdt*TMfcNT L • 
NO. OF SUUeCTS IN TRfAfHtNT ^ * 

RSQUe^TCD CUIOFF rf^CENTAt.E ^ \9 
*CTU*L CUTOFF Pf »t E N T *(,E S » 
TReATMeNT L -30}ili0 
TNEATMeUT I -Si. 11(100 



EXTREMC GROUP SUESr . 

NO. OF SUBJECIS IN E*CH IBEArMENr L G«OuP 
tiO* OF SUBJECTS IN E *f H TKEATHENT i GROUP 



SOURC E 

GROUP (0) 

TREATMENT («T I 

CXI 

ERROR 

TOTAL 



SS 

•490. 00 

33111 '^.00 



OF 

1.00 
1.00 
L.a0 
' S6.00. 
S9.00 



MS 
L0fc.6r 

106. 

1^0. 00 



. rLiL 

. 711L 



.49 7^<)» 
.000000 



POMER 
.1>1],0} 
^31.103 
1.000000 



TREATMENT MEANSi 

TREATMENT 1 ■. 49. 13) 
TREATMENT 2 • 47.167 

GROUP MEANS I 

HIG(* ■ 49. 13 3 

LOW - 4 7.167 

*• <> 

GROUr lY TREATMENT MEANSt 

TREATMENT l-Hl » 71. 333 
TREATMENT 1 Ld * 29. 333 
TMEATMENT 2 HI > 2S. 333 
TREATMENT 2^ LO - 66.000 



I igurr UonUruircli. Prinlvd ot///H// tor program XC.KOUf^S rxdm- 
^ p\o problrm. , ' * ' 
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EXTR^Mfr GROUPS ANALYSISi I.EVEL 4 

NO. dF SUiJECTS 1^1 TREATMENT I ■ 
NO. 0F= SUiJECTS IN TREATMEN-T 2 » 

REQUESTED CUTOFF PERCENTAGE > 40 
ACTUAL CUTOFF PERCENT^ptSj 

TREATMENT \ >4>|.K.]0II 

TREATMENT 2 XrO.iVf* 

EXTREME GROUP SIZESi 

NO. OF SUIJECTS (JN EACH TREATMENT 1 GROUP ' 20 
NO. OF SUBJ^TS IN EACH TREATMENT 2 GROUP ' 20 



SOURCE 
GROUP (G> 
TREATMEHT(n 
GXT 

ERROR X 
TOTAL 



SS 
15. 31 
70.31 

1.3046*75 
374 7^.69 



DF 

1..0I 
1.00 
1.00 
76.00 
>9.00 



,MS 
- fl.5.31 
^0.i»l 
24325.31 
171.9* 



.0190 ; 

.40Q9 

l'^1.461V 



.763779 
.5315A9 
.000000 



POWER 
.052<^'39 
.092554 
1.000000 



TREATMENT MEANSi " » 

TREATMENT 1 * 49.375 
TREATMENT 2 * 47*500 

GROUP MEANSi 

HIGH - . 41.075 
LOW " 4t.000 

GROUP IV TREATMENT MEANSi 

TREATMENT 1 HI > 67.250 
TREATMENT 1 LO > 31.500 
TRfATMENT 2 >II > 30.500 
TREATMENT 2 Ll) - 64.500 



^ND OF JOI, 




h^urc^ 10 (( onliniK^fj). Pnnlvd oulfKii for program XCROURS cx^m- 
' ' I ' * P'^' pfohlvm. . ' - 



Methodologkal Notes 

XGROUPS 



7. . Cjvnvral 



The considt»rati()n of statistical power, is c rue lal to any field of inquiry 
in which researchers consistently fail lo reject t the null hypothesis. ^ 
This has tended to be the case in the field of aptitudcMrealmenl jn« 
teractlon (ATI) research wherein relatively few significant interactions 
have been reported. For example, Bracht (1971), who conducted an 
extensive revic»w of the ATI literature, could report finding c^rrty five 
significant. interac tions afnbng 90 studies which hypolhesizt^d an ap- 
litude-hy-lrcMtmt^nt interaction. ! 

Evert though seemingly crucial to the intrepetation of an ATI study 
that fails to re|(H t the null- hypothesis, statistical power is rarely, if 
(*ver, reported in ATI research. This circumstance is no doubt in- 
fluenced m part by the complexity of the*conc(»pt of f)ower and. 
sometimes by the laborious Ct^feulaiions th^t often nec^d be per- 
formed in the absenceOf any hancJy programming routines. 



2 Power " , 

tof;)en (1969) in his Statistii&l Powvf Analyses for thv Behavioral 
Sc /t\nc es provides tablets that are reasonably good approximations (or 
•estimating levels of powc^r for the anajyUs of variance. Cohen usc»d 
the following three sources for cons^tructing these tables; 

A Laubsc her's ( 19f)0) s^quare root normal approximat-ion of non- 
central F, given by thc^ formula; * 



2(u 4"Ai 
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uF 



i2v ~ 1) ■ 



'7-^/3 



uF 



u 2K 



-I- 



7/2 



I2M 



:erlc 



where / j ^ normal deviaU' which cleterniines the valbie ifi 
power; u. the cli'grees ot treeclom in the numerator ot the obtained f- 
raliiv 'f^y; the degrees ot freedom in the dc'nomlnator (jf F^,; 
\ - i^^u, and the /-ratio re(]uired't()r signitu ance. The value ot 
()ower 'Usually symboli/ed as / -- /j/ is the ()robal)^y ot obtaining a • 



normal debate at bast as small as / 



In other words^ the value 



ot power T'quals the normal ( urve area trom - oo to / ^ _ ^, (liven 
that f)ower is symboli/ecJ as / - (i, then \^ the compk'rnent ot 
power-or alternatively is the risk ot making a Type' II error, ol ac- 
(epting t,he null hypothesis when it is talse. Note that \ and, 
theretore, ()()wer are tundions.ot the (ell trecjuency, n.'A? employed 
'here, cell trecjuency reters to the number ot score's upon which cMC'li 
groitf) mcMn relevant to the comparison is based. The value ot 
'apfHoximates/nrrY/^^'^ '^o '^^"^ ^^^^^ inc rease as cVll trc^quen- 

( v inc rcMsc^s The sc^juare root normal ajiproxjmation 1231 is best suited 
tor generating power values when n and are not small, 

B When n and f^, arc* small a second approximation is rnost-ap- 
propriate. This ts Laubscher's ( ube root normal approximation ot non- 
(entral f, given by the tormula: 
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2 



9v 



U ■¥ k 



1/3 



9vl[u + A 



v+- 

9(u + \)- 



1/2 



1241* 



where u, \, and \ are as defined above, 

( The tinal s()ur(e ot values tor Cohen's tables were tabkvs pro- 
vided him by thV National Bureau of Standards, These tables provide 
exac^ power valuers tor combinations ot a limited number (5f values 
t^r n. ih r(, an(j\. Cohen reconc iU^d his approximations with the j(^x- 
act values that'were available trom thci National Bureau of Standards. 

ProgratTi XCROUPS inc ()r()oralc*s a. power estimating function 
(tunction P6)W[R^) which provides power estimates corresponding to 
Cohen's tabled values for differing values of v/F^j-and F^ for'the case 



94 



H7 



in whic h u = /. \hvsv powc^r Viihics arc ^(Mieratcd through using both 
the siquare root anci th(» cubo root approximaHons, depending upon 
wh^nher n is large or small. These, af)proximations give^normal devi- 
^ ate values .torresponHmg to pow^ (i.e., / ^ _ To obtain the pro- 
bability value associaied with this z, itv tollowing approximation^ 
derived from Fjtisjtnj^s \1955). is used: 

(a) -^the absolute ij'alue ot the /oscore is taken; \ < 
ib) then the absolute^'value of the / score is used In the formula: 



en tjit 



• ^ .5 

p = 




12 



where .mH54( e^ = ,115194, = .0003-44 and' 
I , . c , =^ (M)r>27; 
H( ) then if the / score is positive,- pow^rjs equal to J ~ p or, if 

the / scor(* is negative, power is equal to p. 

• ■ 

The re^'ason tor stej) (c) Is that the above apf)roximatlon for the pro- 

"t^abil ity associated vyith a / score gives the probability of obtaining a 

■ „ -/ score as extremc^^as that obtainc^d and with the same sign as that ob- 

tamecl. In other worcis, c^quatlon J25l .gives the smaller ♦normalYurve . 

.area bounder! by the / ^core. WitTi regard" t(3 powe^, however, the 

normal c yrve arcM t<om -oo to the / ^ow is of interest. Equatipn |25l 

gives rhis area when the / score is nc^gative. However, when the / 

score IS po.sitive, equat!()n |2SJ gjvc's the tompiemoat of the desired 

a^rea. Thereforc\ step (c) is inc luded to.set power equal to p when the 

./ score is nc^gative arid c^qual to the complemc^nt di p when the z 

score is positive. ■ ^ - ^ "* • . 

*>• ' * . ■ ^ ' . 

: " '■ 

I Acc urate V of Fur^ction PjOWER . - ^ 

Boric h aJid (iodl/out (1 974)^ tc^sted' the ac ciuracy^of the two approx- 
imatjons for prower '^against Cohen's^Hablc^d values 'by performing 96 
calculations of power wiith different value's of n (cell frequerfcy), 
(the obtained f) and ^^ (ihv F value n(>t;ded.f()F'-significance at the .05 
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K>V('I) Iho va]u(' n\ (/; ihc nurntn^r ot dt^i^-nu^s ot InHniom in ihV 

nijrrn»MU')r, was alvv^ivs ()n(\ as inu^rcsi was lifTiiUnl lo (MleUs mvolv- 

" ' . inj; a smgt^ dt'H'^^'^' ot*fro<Hl()nv rh(^r(»t()r(\ this ac ( urac v K^sl was ac 

r . . 'Uiallv iimit(»<) to ((^riarni rombmalions ot valuc.s tor and n '/^ Immm^ 

. (IrU^^rmioc'd by n). Ihtvs()uar(* root- apfKoximation mauhinl ( losi^sl lo 

' C ohj<"»n|s.tabl(H-i v^iluoswhrn n was 4 (,)r ^r(\Ut»r,- wfu^rras [hv iubb 

ro()la[-)f)roximaUon mali iKnlt !os(»sl whcm a was k^ss than 4. Kmc liorl 

' l^)AVl,K; thcroturo, rnlj)loys ihv scjuaro root appro^jiqiatjon whon^ ' 

^ *n > 4 tvnd lbi'^iib(» r()o.t' a[^proximation \\/hvn n < 4. " 

»»'•' . ' [ / • «■ 

« ... . 

4 \:vlllnH]uvnl\ ' ' . ■< ^ ^ * , 

; A (aiMion shoCiid hv (\x[)ress(xl (1)n( errting ihu moanmg ot coll tro- 

(|iuMMy, n, as the [m^sont usa^i* olihi^ t(Tm Ts somrWb^V unorthodox. 
( (•II tnH)utm( y ro[)r(^s(Mits numbvf^ni stprvb j^roduc ing a^mivin of 
- /JrvU^rc^st "lh(^ nHVins ot int(^/osl art^ ihoso U[)on whic h th(^ pbtamc^d F- 
Valio IS basted; As^iil ^xarTi|>^t\ ()no may lonsi(k;r a 2 X 2 design 
A'ith''lO SCORES pvr (elL/thi^ /^^ lor ihv row rttoU'is bas(Hi upon iWQ 
mtvins i\M h ot whu If is/dint^mtnoci by 2()S( orc^s. Ther(Mor(\ thc^ vajuo ^ 
ot /ris 20 t(K delerminalion of the [)owrr ot the signitKance lost gf 
• 'ihf row t'tftu l/Sinailar!ly,.tihe value of n is 20 tor the determination of 
[hv f)ow(T ot the signUii ctnrc t(*sl ot tht^ (olumn effiTt/lri contrast, 
' • tht^'^row X (olurnln interaction is bascni upon comparison ot all t()ur 
' ' *• ( ell mcMHs and the Vatue of n is lOJor the determination of the power 
• ot^ the significanc(^ test ot-the^ mteraction. It should be notc^d that thy 
(e// irrqurni v (as [)rc>sent^y*<:i(^fined) fyr thv /es/. o/ tho main 

t\ bin only 10 tor th'v t(\t\)t thv inlvuutiun. This tower cell'fre-' 
.(|uency ass(Hiat(Hl with the int(?rac tion illustrates an ;ln»teresting 
general prmcif)l(* cone erning j)oWer analyses/Power is' a positive 
' /tune lion of e e'll treHjueney. Ciiven.e^qual effect sizes and degrees of 

treH'dom. the*"^ lower e e>ll tr(,H)uenc y tor the interac tion te^st jmplicis that 
the f)ower of the test of the^ interae tion witl bv lower than t+ie power 
, ot the te^sts of the mam eff(\e ts.ThLs lowOr f)Ower for interaction te'sts 
has be>en ue»nerally overlookenl bv the^ ATI re>VMre-her. • . 
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5. ApplKattons tnvoh inf* Slajisin \}l Powvr 

Stdtistical power is a^ositive function ol tho cHI Iretjuency, the 
vUej^ Hi/€\ and the alpha level chosen tor slj^nitlcance. An mt rease in 
any one of these l-hrt*e cjuantitit^s^will cause an incrcMse in power. As 
iin illustration of the influence of the alpha k»vel, consider an exru^ri- 
nientt»r who has just calculated a 2 X 2 extrc^me^groups analysis for* 
which he has hypothesizc*d that an interac tion would be significant at 
the .01 k»vel. The experimenter tails to rc^jin't the null hypothesis and 
estimatc»s. that the power of tfje analysis'is .60; that is, he^ risks missing 
an i?^tt*ractiori in four studic*^ Out ()f every ten. The experimonli'T is 
concernc»d that he may have chosen too low a value tdr alpha and 
that this low value alone may have* unduly limited the f)owi»r of his 
ex()cvim€*nt and thus may have increast»d his chances of making a 
Type It terror. But could he apprc»ciably increase his powt»r by raiding 
the alpha level in future studies^ If a dc»sirable k»vel of powc^r, sue h as 
one betw€»en .70 and .80, could not be obtaini»d ewn by^rncreasrng 
•alpha to as high as .10, this rescMrc.hef eithc»r should abandon this par- 
ticular research or sh(C(^uld c()nsid(*r a more powerful design. 

Power is most usually raisc^d in a given c*xperiTnt»nt by increasing 
the number of subjects in that expc^riment. \i powc»r is estimated and 
found to be low, the cost of improving it by increasing sample size 
will usually prove to be well worth the c^ffort. If, on the other hand, 
p(7wer is c»stim^tc»d and found to be high, say, in the neighborhood of 
.80 to .90, the rc^searcher will find that an increase in n, even of a large 
magnitude, may not substantially increase power further. It is not 
unusual for power values as great as*90, or higher, to demand sample 
sizes that exceed an experimenter's, resources. The benefit of increas- 
ing sample size to gain power is therefore greatest for the researcher 
whose expc'riment has initially moderate or weak power. 
' Another way of increasing power is'to increase the effect size. This 
is the strategy employed in the extreme groups analysis. The ATI 
researcher who chooses to employ the extreme groups technique is 
faced with a tr^de-off: What percentage *of the distribution should he 
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av>ign lo Iho iwo (^xtri^nic^ in ordvr lo have a reasonabk' kwel of* 
'f)()wer^ This ciui^slinn presents a (lilenima which may be clarified by 
consickTing ^^ prac hcaU^siample. Consider a sample of 100 suhjec ls 
from which Uvo extreme groups are to be selected tor analysis. The 
(extreme gr()Uf)s strategy dKtates that the two j^rouf)^ be torirK^ so* 
ihal one inc ludes the subjec tvscoring highest (ift the aptitude and the 
other includes the subVc;ts storing Iciwc^^t on the aptitudo/Each ox- 
. lremegr<)Uf) can contain as raany as SQ subjects as an upper limit (the 
high group being subjec ts abov^u the median and .the* low group being 
subjec7s^elx)w the median), oreach (»^treme group can 'c^ontain only 
a tew subjects, e.g., t.ive (the high' group being the individuals with 
the five high(»st scores and the low ^roup being t'he individuals with 
the live lowest s( ores). As the^wo grouf)s. become more extreme, the 
.c-orresfjondmg incn»nnent in t^e difterence.betrween their mc^ans Ti.e,, 
the ettec I si/e) c auses power to inc rease. hiowever, as the two groups 
become more extri>me, the'numbc^r of subjects in a group (i.e., the 
c(»ll trequencyj decreases and power diminishes. Thus, as the 
selected groups become more extrenit\ the presence of antagonistic 
effects on f)ower leaves unclear what tHl» c hange in f)(>wer will be. 
Program XGROUPS ^^as bcH*n designed to assist the ATI researcher in 
reconc iling the need tor mc rcMsed [K)wer with a resultant dec rcMse in 
sample si/e. i.e., to h(*lp him choose the number of cases that when 
ass!gn(»d to extreme grou[)s yields the most acct»ptable level of 
f)ower. , 



^) TrCcUmcnt x BUnks AMOVA 

\ )^ ' • \' ■ 

The stancWi analysis for the extreme groups design is a treat- 
ment x bUk ks ttnolysH of varianc/v Program XGROUPS is appropriate 
to a i X 2 extreme groups design involving two treatments and two 
'extreme af)titude groups within eac h treatment. An aptitude variable 
is used to establish high and categories within cMch treatment. 
for Treatment 1 , ec|ual percentages of the Ss are assigned to high and 
low extreme gr(>ii^)s. The same f)e,rcc-ntages of Treatment 2 Ss are 
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assigned to th^two oxirome groups * If the total numbers of Treat- 
ment 1 arid Treatment 2 .Ss ate not exiual, then the resuUing extreme 
groups design will involve unequal n's. While unequal n's often 
greatly complicate calculation and interpretation of an ANOVA, this 
is not true m the present case. Since Program XGROUPS forms equal- 
sized high and low aptitude groups within a given treatment, the cell 
frequencies in the resulting extreme groups dejiign will always be 
proportional and conventional ANOVA calculations and interpreta; 
'tions are applicable (Kirk, 1968; Winer, 1971). Program XGROUR^i, 
therefore, employs conventional ANOVA calculation techniques. 
Program output includes mean squa/es for treatments, levels (high vs. 
low}, treatments X Jevelsf and residual error. The f-ratio for /reat- 

ments x levels is the test for aptit'ude-treatmeht interaction. / 

- /' 

* ^ ^ • : ^ ^ ' . / ; 

•Formation of extreme groups can be complicated by Ss vyith equal 
. aptitude scores. Consider an aptitude that assumes integer values 
from 0 to 10. Say five Ss are to be included in the high c<ltegory but 
that fpur Ss received a maximum score of 10 while three Ss received 
the next highest possible score of 9. Which five Ss'should be included 
in the high category^. In this case, program XGROUPS forms a high 
group consisting of the four Ss with" scores -of 10 and a tingle 5 
(selected by a random number function) with a store of 9, 
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CHAPTER VII 
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•TAbIe OF"PReDICTOR AND CRITERION SCORES LISTED BY SUBJECT WITHIN TREATMENTS ^ 



TREATMENT 1 



n 

000. 
022 



00> 
00> 
00' 
001 
00« 
010 
011 
012 
013 
01A 
015 
-"01«P 
017 
018 

019 

020 

021 

02 2 

02 3 

024 

025 

026 

027 

02 £ 

02 c 
03C 

03; 

03 - 
03 
03 , 
03 
03 
07 
08 

09 ' 
00 
(21 
02 
03 
fr4 
(tS 
44» 
47 
A8 
IA9 



PREDICTOR 1 


PREDICTOR 2 


^10.000 


70.000 


15.000 


70.000 ' 


20.000 


7^.000 


2 5.000 


75.000 


30.000 


75.000 


20.000 


80.000 


35.000 


80.000 


40.000 


» 80.000 


30.000 


85.000 


40 . 000 


85.000 


*50M000 


^ 70 . 000 


^2 5.000 


70.000 


30,. 000 


65.000 


4 5.000 


65.000 


55/!>000 


. 65.000 


' 35.000 


75.^000 


40.000 


70.000 


50.000 


65.000 


35-. 000 


60 . 000 


^ .000 


55.000 


''^0 . 000 


60.000 


65 .000 


5^000 


40 . 000 


50.000 


45.000 


50.000 


50 . 000 


50.000 


^60*000 


50.000 


*65.000 ' 


50.000 


70.000 


50.000 


50 .000 


^5.000 


50 J3i90 


45.000 


55.000 


4$. 000 


60 .000 


45.000 


^ 65.000 


40.000 


70.000 • 


40.000 


75.000 ' 


40.000 


60.000 


40.000 


70 . 000 


35.000 


80.000 


35.000 


60.00Qr 


V 35.000 


65.000 


^ 30.000 


70.000 , 


30 . 000 


75.000 • 


30*000 


85.000 


25.000 


70.000 


2 5.000 


80.000 


2 5.000 


7 5 .''000 


20 .0069 


85.000 


20.000 


90.000 


i5.ef)0 


\ 85.000 


15.000 


> 90.000 


5.000 



CRITERION 
5.000 
15.000 
15.000 
20.000 
20.000 
2 5 . 000 
2 5 ..000 
2 5.000 
30.000' 
30,000 
30.000 
35.000 
35.000> 
'35.000 
35.000 
40.000 
40.000 
40.000 
45.000- 
45.000 
45.000 
45.000*^ 
50.000 
50.000 . 
50.000 
50.000 
50.000 
50.000 
55.000 
60 ."000 
60.000 
60.000 
60.000 
60.000 
60.000 
65.000 
65.000 
' 65.000 
70.000 
70.000 
70.000 
70.000 
70.000 
75.000 
75.000 
80.000 
80*000 
80 ..000 
85.000 
85.000 
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TREATMENT 2 



ID 

. 051 

052 * 

053 

054 

055 

056 

057* 

058 

059^ 

060 

061 
062 
^ 063 
064 
065 
. 066 
067 
068 
-069 • 
070 
071 
072 
073. 
074 
075 
076 
077 
078 
t 079 
080 
081 
082 
083^ 
08,4' 

411 
087 

088 ^ 

089 

090 

091 

092 

093 

094 

095 

096 

097 

098 

099 

100 



<2> 



PREDICTOR 
0.000 
5.000 
5.000 
10.000 
15.000 
15.000 
20.000 
251.000 
25.000 
30.^0 
30.000 
30.000 
35.000 
35.000 
40.000 
40.000 
40.000 
45.000 
45.000 
50.000 
50.000 
55.000 
55.000 
55.000 
55.000 
60.000 
65.000 
65.000 
65.000 
70.000 
70.000 
70.000 
70.000 
70.000 
75.000 
75.000 
75.000 
75.000 
80.000 
60.000 
80.000 
85.000 
85.000 
85.000 
85.000 
85.000 
90.000 
90.000 
90.000 
90.000 



PREDICTOR 
60.000 
70.0^0 
55.000 
75.000 
70.000 
60.000 
75.000 
75.000 ^ 
65.000 
70.000 
45.000 
65.000 
55.000 
75.^00 
70.000 
60»000 
55.001} 
. 50.000 
75.000 
65.000 
2 5.000. 
65.000 , 
40.000 
30.000 
55.000 
70.000 
55:000 
50.000 
40.000 
65.000 
^ 45.00(9 
15.000 
50.000 
40.000 
30.000 
20.000 
60.000 
55.000 
45.000 
35.000 
30.0Gf0 
20W000 
10.000 
0.000 
45.000 
35.000 
'25.000 
15.000 
10.000 
55.000 



CRITERION 
70^000 
65.000 
. 75.000 
75.000 
.60.000 
70.000 
75.000 
- 55.000 
70.000 
60.000 • 
65.000 
' 75.000 
50.000 
55.000 
60.000 
70.000 
75,000 
5&.000 
' 65.000 
45.000 
65.000 , 
40.000 
50.000 
55.000 
70.000 
' 55.000 
30.000 
40.000 « 
65.000 
25.000 
35.000 
45.000 
55.000 - 
60.000 
20.000 
30.000 
40 . 000 
50.000 
15.000 
45.000 
55.000 
^ 10.000- 
15.000 . 
25.000 
35.000 
45.000 
0.000 
10.000 
20.000 
3£).000 
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CHAPTER VIII 
ANNOTATED BIBLIOGRAPHY 



Abelson, R. P.' A hole on the Neyman-lohnson technique. Psy- 
•chome<r(ka, 1953, 78(3), 213-218. 

' . . ' . . ... 

This actic le discusses the rationale for the Johnson-Neymah techni- 
que and the hypotheses that should be preliminarily tested before 
the technique is used. Specif itally, the artjcte suggests testing the hy- 
potheses of (1) homogeneity of group varii^ces and (2) equality of 
group regressipp slopes. If hypothesis (1) is rejected, It is theoretically 
not permissible to continue. If hypotheses (1) and (2) are both a^:- 
cepted, the author Suggests testing the hypothesis that the intercepts 
are equal for the two groups. If hypothesis (1) is accepted and (2) is 
rejected, then the johnson-Neyman technique is utilized. The author 
presents a method for the computation of the regions of sigrvfi^^nce 
tor any number of predictors. 

Cahen, L. S , & Linn, R. L. Regions of significant criterion differences in 
aptitude-treatment-interaction research. American Educational 
Research lournal, 1971, 8(3), 521-530. 

This article compares three techniques for (determining regiisns of 
significant criterion differences when the effect of treatment interacts 
with the aptitude (predictor value) of the subjects in question^ Com- 
pared are the johpson-Neyman technique, the Potthoff modification 
of the lohnson-Neyman technique, and the Eriander and Gustavsson 
methpd.'the authors demonstrate that the thi[ee technics differ in, 
their estimates of the size of the region of significance: ^ 

)ohnsoa P. O.: & Fay, L. C. The Johnson-Neyman technique, its theo- 
ry and application. Psychomem/ca, 1950, 75, 349-36^^ 

A detailed theoretical derivation of the johnson-Neyrraan techni- 
que for determining regions of significance for Interacting regression 
lines is presented. Also presented is a step-by-step computational ex- 
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ampl^ problem in which there are two covariates (aptitudes), two 
treatments and one criterion measure. 



Johnson, P. 0./&r Jackson, R, W. B. Special applications of multivariate 
analysis. In Modefn statistical methc>ds, Chicago: Rand McNally, 
^ 19^9.410^455/ 

The authors discuss the Johnson-Neyman method, for comparing 
groups that have been measured on some aptitude icovariate, here 
♦called "matching" variable^ The.authors first consider using Ihe tech- 
nique whfen the aptitude is qualitatively of. categorically defined (e.g., 
sex, pee). Second, the authors discuss at h^ngth tlie more frequent 
case in which the aptitude variable if quan/tatively. defined 
(measurable across a'range). Within this cas(i, two^xamples are dealt 
with, one having a single aptitude and the^sec^d having two ap- 
titudt^. ' ' 



Johnson, P. O., & Neynrian, J. Tests of certain linear. hypotheses and 
their application to some educational problems. Statistical 
Research ^fcmo/f5, 1936; 7, 57-93. ' 



This article contains J:he original formulations of the Johnson-Ney-> 
man technique for determining regions of significance. The greater 
part of the article is devoted to 'a det^led mathematical derivation/bf 
the technique, although space is amy reserved for a discussion of/ihe 
kinds ot research problems for wfmh the technique is appropri^e. A 
numerical example is preserjt^d. 

a- 

Koenker, R. H., & Hansen, C. W. Steps for the application of the 
Johnson-Neyman technique — A sample^analysis. journal of Experi- 
mental Education, 1942, 76(3), 164-173. ' ^ / 

A computational example using the Johnson-Neyman technique is 
presented. The problem analysis has" two groups, one criterion/ and 
two aptitude variables. A detailed computational procedure is pre- 
sented. 



Potthoff, R. F. On the Johnson-Ney/rian technique and some exten- 
sions thereof. Psychometrika, 1964, 29, 241-255. . 
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The article starts by reviewing the [ohrtson-Neyman technique, 
suggesting when it should and should not be used. Sevt^ral modifica- 
tions of the technique are then presented which:. 

(1) consider regions of significance as confiderice intervals; 
. (2) use siniultaneous confidence intervals instead of plotting the 



region of significance; 

(3) • consider the case having more than two groups; 

(4) consider tbk case having more than one criteriprf^ 
Several simple wucnerical examples are presented. 



Walker, H., & Lev., ). Analysis of covarj^^e. In S{a{\s{\ca\ intorcnco. 
New York: Holt, Rinehart and Winston, 1953,-387-412, 

This chapter presents a d^^fivation of the analysis of, cov^rjance 
model with a computational i^xample having one covariate (ap- 
titude), two treatments^lgroups, populations) and one criterion. Also 
presented are (1) an f-test for the hypothesis of equality of group 
regression \\nesJ(2) an f-test for the hypothesis pf equality among ad- 
justed group/(criterion) means, and (3) an^f-t'est for the hypothesis of 
linearity or the regression line based on group means. • 

For an example having one covariate (aptitude), two treatments 
(groups/populations) and one cf^iterian, a method for determining (1) 
point ,of nonsignificance (the intersection of group regression 
Tines), (2) the region of nonsignificance (those covariate values for 
which the treatments do not differ significantly), and (3^ the regions 
of significance (those covariate values for which the treatments differ 
significantly) is presented. ; , 

Finally, for an example having two coyariates, a method for deter- 
mining the regions of significance and nonsignificance is presentedi 
These regions are defined by all combinations of covariate values for 
which differences in the treatments do and do not differ significantly. 
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The article starts by|i?viewing the John^pn-Neyman technfque, 
suggesting when it should and should not Be used. Several riibdifica- 
tlons of the technicfue are then presented;which:>, 

(1J consider regions of significance as confidence intervals; 

(2) use sin)ultaneous eonffdenee inHirvals instead of plotting th^ 
. . ^ region of significance; 

(3) , consider the case having more tj;)an two groups; 

(4) consider the' case having niore than one criterif 
Several simple numerical'examples are-presentec 



Walker, Lev., J. Analysis of covartswice. In Stau$ucat inference. 
New York: Ho^ll/Rinehart and Wirl^on, 1953^387-412. 

This chapter presents a d/srtfvaUon of the analysis of, cov^nance 
model with a computational i^5;ample having one covariate (ap- 
titude), tvyo treatmeri^«^groups,.popglat!ons) and one criterion. Also 
.presented are (lj an F-test for the hypothesis of equality of group 
regr^sion lineyK) an F-tesl for the hyppiheMs of equality amongad- 
justed grouD/^Uiterion) means, and i3>an^f*test for the hypothesis of 
linearity ofihe regression line bgs|3 on group means. 

For an-example having, one cov|iriale: (aptitude), two l^re^tments 
(groMps, populations) and one cjjlericwi,-^ method for determining 11) 
the point .of nonsigmficarice (the intersectjDft of group regression 
lines), (2) tha region of npnsignificance (those covariale .values for 
.Which the treatments do not differ significantly), and (3) the regions 
of significance (those covariate values for which the treatmegts differ 
significantly) is presented, 4' 

Finally, for an example havjng two covariates, a method for deter* 
mining the regions of significance and nonsignificanco is presented* 
The$e regions are defined by all combinations of covanate values (or 
which differences in the treatments do and do not differ significantly. 
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The artitle btarts b> redwing the^^Iohf^onAevman technique, 
suggesting when d should and >huu!d not be usc*d Sevewl mtxJiliLd- 
uons of the technique are then presented whjch.^ . T , - 
'1' consider regions of s.ig0iiicance is confider^u? intervals. 
. 2 use stnTullaneous c<inf ideate intervals ir^iead of pVjiting ihex 

region of significance: . 
3) consider the case having nK>r^ihan'two*groups^^ 
(4j consider the case havmg more^han'on1§ criten^; 
Several simple oumencal ex^pJes are f>resenif 

Walker, H.. & lev., h Analy^si^ of cqvm^e. lo 5wtisOca/ mtcrcnce. 
New York: Holt, Rinehart 2X\6':i^}mhn, 1953,-^387-412. 

"7; ^ 

_ This chapter presents a dj?^atid!i 'c^f^he analysis of cov^anance 
riiodel^jth 'a conipiJiatijdnal ji^^rpf^ having one cgvapate :ap- 
tiludeJ, two treatfTiemx\groups. pf^i^atrons. and one criten.un. Also 
.presented are 'l.'ian f-iesl for the hf }*^lhesis of equality of group 
. reg&ss.ion Imes/^i an F-tcsl ftff the hypothes4s of equafit^ among ^d- , 
justed gfoup/Uiterioa mean^and ivn/ lesl kjr the hypoUiesisof * ~ 
^ linearity oHhe regression fine i?ase^^^ 

For a^e>Amp\e having one cov^^&(^j\aptHude,y two l/e^jtnients 
^gro^s, populations., and one Cf^iten^, a metho^ for dete/mining vIj 
ib^ point ,of nonsigmficante Uhe irners^.ectioh of .group regression 
fines?, the region of nonsignificance Ilhose.cov£naie viilues for 
wh^th the treatments do not diffe; sigjSLcantJy/, and Gj the regions . 
of significance Ithose tt^vanafe vatups for whidtthe treatments differ , ^ 
significantly) Is presented. X/' * x 

finally, for an example having two tovanates, a method for. deter- 
mining the regions of sigmficante^nd nunsignifitance is presented. 
These regions are defined fay all combinations of cuvanate values for ^ 
whith differences in the treatments do and do not differ signifjcani.^. 
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